2019-01-14 13:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:25:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:25:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:25:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:25:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:25:04 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-14 13:25:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 13:25:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 13:25:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 13:25:56 [DEBUG   ] Got command RPT from MCS: ref #1166607
2019-01-14 13:25:56 [DEBUG   ] summary = ERROR
2019-01-14 13:25:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166607  13 58497 48356481 A  ERRORERROR'
2019-01-14 13:25:56 [DEBUG   ] Got command RPT from MCS: ref #1166608
2019-01-14 13:25:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:25:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166608  77 58497 48356685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:25:56 [DEBUG   ] Got command RPT from MCS: ref #1166609
2019-01-14 13:25:56 [DEBUG   ] summary = ERROR
2019-01-14 13:25:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166609  13 58497 48356877 A  ERRORERROR'
2019-01-14 13:25:57 [DEBUG   ] Got command RPT from MCS: ref #1166610
2019-01-14 13:25:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:25:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166610  77 58497 48357081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:25:57 [DEBUG   ] Got command RPT from MCS: ref #1166612
2019-01-14 13:25:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 13:25:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166612  12 58497 48357285 A  ERRORB˜™š'
2019-01-14 13:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 13:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:26:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:26:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:26:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:26:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:26:04 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-14 13:26:04 [DEBUG   ] Got command RPT from MCS: ref #1166623
2019-01-14 13:26:04 [DEBUG   ] summary = ERROR
2019-01-14 13:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166623  13 58497 48364705 A  ERRORERROR'
2019-01-14 13:26:04 [DEBUG   ] Got command RPT from MCS: ref #1166624
2019-01-14 13:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166624  77 58497 48364706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:26:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 13:26:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 13:26:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 13:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:27:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:27:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:27:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:27:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:27:04 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-14 13:27:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 13:27:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 13:27:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 13:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:28:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:28:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:28:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:28:04 [WARNING ] (13, 1, 'bot')
2019-01-14 13:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:28:04 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-01-14 13:28:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 13:28:29 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-14 13:28:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 13:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:29:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:29:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:29:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:29:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:29:05 [DEBUG   ] Finished updating board flags in 2.046 seconds
2019-01-14 13:29:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 13:29:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 13:29:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 13:30:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 13:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:30:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:30:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:30:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:30:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:30:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:30:05 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-14 13:30:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 13:30:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 13:30:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 13:30:56 [DEBUG   ] Got command RPT from MCS: ref #1166647
2019-01-14 13:30:56 [DEBUG   ] summary = ERROR
2019-01-14 13:30:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166647  13 58497 48656561 A  ERRORERROR'
2019-01-14 13:30:56 [DEBUG   ] Got command RPT from MCS: ref #1166648
2019-01-14 13:30:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:30:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166648  77 58497 48656765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:30:56 [DEBUG   ] Got command RPT from MCS: ref #1166649
2019-01-14 13:30:56 [DEBUG   ] summary = ERROR
2019-01-14 13:30:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166649  13 58497 48656969 A  ERRORERROR'
2019-01-14 13:30:57 [DEBUG   ] Got command RPT from MCS: ref #1166650
2019-01-14 13:30:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166650  77 58497 48657173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:30:57 [DEBUG   ] Got command RPT from MCS: ref #1166651
2019-01-14 13:30:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 13:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166651  12 58497 48657365 A  ERRORB˜™š'
2019-01-14 13:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:31:04 [DEBUG   ] Got command RPT from MCS: ref #1166652
2019-01-14 13:31:04 [DEBUG   ] summary = ERROR
2019-01-14 13:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166652  13 58497 48664709 A  ERRORERROR'
2019-01-14 13:31:04 [DEBUG   ] Got command RPT from MCS: ref #1166653
2019-01-14 13:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166653  77 58497 48664710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:31:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:31:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:31:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:31:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:31:05 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-14 13:31:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 13:31:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 13:31:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 13:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:32:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 13:32:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:32:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:32:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:32:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:32:05 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-14 13:32:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 13:32:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 13:32:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 13:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 13:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:33:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:33:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:33:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:33:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:33:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:33:05 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-01-14 13:33:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 13:33:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 13:33:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 13:34:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 13:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:34:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:34:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:34:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:34:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:34:05 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-14 13:34:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 13:34:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 13:34:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 13:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:35:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:35:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:35:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:35:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:35:05 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-14 13:35:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 13:35:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 13:35:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 13:35:56 [DEBUG   ] Got command RPT from MCS: ref #1166679
2019-01-14 13:35:56 [DEBUG   ] summary = ERROR
2019-01-14 13:35:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166679  13 58497 48956645 A  ERRORERROR'
2019-01-14 13:35:56 [DEBUG   ] Got command RPT from MCS: ref #1166680
2019-01-14 13:35:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:35:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166680  77 58497 48956849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:35:57 [DEBUG   ] Got command RPT from MCS: ref #1166681
2019-01-14 13:35:57 [DEBUG   ] summary = ERROR
2019-01-14 13:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166681  13 58497 48957053 A  ERRORERROR'
2019-01-14 13:35:57 [DEBUG   ] Got command RPT from MCS: ref #1166683
2019-01-14 13:35:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166683  77 58497 48957257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:35:57 [DEBUG   ] Got command RPT from MCS: ref #1166685
2019-01-14 13:35:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 13:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166685  12 58497 48957449 A  ERRORB˜™š'
2019-01-14 13:36:04 [DEBUG   ] Got command RPT from MCS: ref #1166689
2019-01-14 13:36:04 [DEBUG   ] summary = ERROR
2019-01-14 13:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166689  13 58497 48964701 A  ERRORERROR'
2019-01-14 13:36:04 [DEBUG   ] Got command RPT from MCS: ref #1166690
2019-01-14 13:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166690  77 58497 48964702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:36:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:36:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:36:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:36:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:36:05 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-14 13:36:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 13:36:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 13:36:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 13:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:37:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:37:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:37:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:37:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:37:05 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-14 13:37:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 13:37:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 13:37:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 13:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:38:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:38:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:38:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:38:05 [WARNING ] (13, 1, 'bot')
2019-01-14 13:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:38:05 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-01-14 13:38:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 13:38:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 13:38:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 13:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:39:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:39:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:39:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:39:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:39:06 [DEBUG   ] Finished updating board flags in 2.064 seconds
2019-01-14 13:39:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 13:39:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 13:39:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 13:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:40:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:40:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:40:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:40:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:40:06 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-14 13:40:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 13:40:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 13:40:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 13:40:56 [DEBUG   ] Got command RPT from MCS: ref #1166710
2019-01-14 13:40:56 [DEBUG   ] summary = ERROR
2019-01-14 13:40:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166710  13 58497 49256737 A  ERRORERROR'
2019-01-14 13:40:56 [DEBUG   ] Got command RPT from MCS: ref #1166711
2019-01-14 13:40:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:40:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166711  77 58497 49256941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:40:57 [DEBUG   ] Got command RPT from MCS: ref #1166712
2019-01-14 13:40:57 [DEBUG   ] summary = ERROR
2019-01-14 13:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166712  13 58497 49257133 A  ERRORERROR'
2019-01-14 13:40:57 [DEBUG   ] Got command RPT from MCS: ref #1166713
2019-01-14 13:40:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166713  77 58497 49257337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:40:57 [DEBUG   ] Got command RPT from MCS: ref #1166714
2019-01-14 13:40:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 13:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166714  12 58497 49257541 A  ERRORB˜™š'
2019-01-14 13:41:04 [DEBUG   ] Got command RPT from MCS: ref #1166719
2019-01-14 13:41:04 [DEBUG   ] summary = ERROR
2019-01-14 13:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166719  13 58497 49264705 A  ERRORERROR'
2019-01-14 13:41:04 [DEBUG   ] Got command RPT from MCS: ref #1166720
2019-01-14 13:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166720  77 58497 49264706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:41:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:41:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:41:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:41:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:41:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:41:06 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-14 13:41:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 13:41:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 13:41:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 13:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:42:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:42:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:42:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:42:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:42:06 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-14 13:42:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 13:42:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 13:42:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 13:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:43:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:43:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:43:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:43:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:43:06 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-14 13:43:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 13:43:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 13:43:53 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-14 13:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 13:44:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:44:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:44:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:44:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:44:06 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-14 13:44:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 13:44:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 13:44:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 13:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:45:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:45:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:45:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:45:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:45:06 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-14 13:45:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 13:45:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 13:45:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 13:45:56 [DEBUG   ] Got command RPT from MCS: ref #1166742
2019-01-14 13:45:56 [DEBUG   ] summary = ERROR
2019-01-14 13:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166742  13 58497 49556817 A  ERRORERROR'
2019-01-14 13:45:57 [DEBUG   ] Got command RPT from MCS: ref #1166743
2019-01-14 13:45:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166743  77 58497 49557021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:45:57 [DEBUG   ] Got command RPT from MCS: ref #1166744
2019-01-14 13:45:57 [DEBUG   ] summary = ERROR
2019-01-14 13:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166744  13 58497 49557225 A  ERRORERROR'
2019-01-14 13:45:57 [DEBUG   ] Got command RPT from MCS: ref #1166746
2019-01-14 13:45:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166746  77 58497 49557417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:45:57 [DEBUG   ] Got command RPT from MCS: ref #1166747
2019-01-14 13:45:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 13:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166747  12 58497 49557621 A  ERRORB™™š'
2019-01-14 13:46:04 [DEBUG   ] Got command RPT from MCS: ref #1166752
2019-01-14 13:46:04 [DEBUG   ] summary = ERROR
2019-01-14 13:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166752  13 58497 49564713 A  ERRORERROR'
2019-01-14 13:46:04 [DEBUG   ] Got command RPT from MCS: ref #1166753
2019-01-14 13:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166753  77 58497 49564714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:46:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:46:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:46:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:46:06 [WARNING ] (13, 1, 'bot')
2019-01-14 13:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:46:06 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-14 13:46:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 13:46:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 13:46:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 13:47:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:47:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:47:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:47:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:47:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:47:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:47:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:47:07 [DEBUG   ] Finished updating board flags in 2.017 seconds
2019-01-14 13:47:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 13:47:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 13:47:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 13:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:48:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:48:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:48:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:48:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:48:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:48:07 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-14 13:48:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 13:48:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 13:48:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 13:49:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 13:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:49:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:49:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:49:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:49:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:49:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:49:07 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-14 13:49:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 13:49:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 13:49:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 13:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:50:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:50:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:50:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:50:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:50:07 [DEBUG   ] Finished updating board flags in 1.874 seconds
2019-01-14 13:50:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-14 13:50:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 13:50:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 13:50:56 [DEBUG   ] Got command RPT from MCS: ref #1166777
2019-01-14 13:50:56 [DEBUG   ] summary = ERROR
2019-01-14 13:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166777  13 58497 49856905 A  ERRORERROR'
2019-01-14 13:50:57 [DEBUG   ] Got command RPT from MCS: ref #1166778
2019-01-14 13:50:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:50:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166778  77 58497 49857109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:50:57 [DEBUG   ] Got command RPT from MCS: ref #1166779
2019-01-14 13:50:57 [DEBUG   ] summary = ERROR
2019-01-14 13:50:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166779  13 58497 49857313 A  ERRORERROR'
2019-01-14 13:50:57 [DEBUG   ] Got command RPT from MCS: ref #1166780
2019-01-14 13:50:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:50:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166780  77 58497 49857505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:50:57 [DEBUG   ] Got command RPT from MCS: ref #1166781
2019-01-14 13:50:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 13:50:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166781  12 58497 49857709 A  ERRORB˜™š'
2019-01-14 13:51:04 [DEBUG   ] Got command RPT from MCS: ref #1166782
2019-01-14 13:51:04 [DEBUG   ] summary = ERROR
2019-01-14 13:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166782  13 58497 49864705 A  ERRORERROR'
2019-01-14 13:51:04 [DEBUG   ] Got command RPT from MCS: ref #1166783
2019-01-14 13:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166783  77 58497 49864706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 13:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:51:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:51:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:51:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:51:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:51:07 [DEBUG   ] Finished updating board flags in 1.720 seconds
2019-01-14 13:51:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 13:51:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 13:51:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 13:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:52:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:52:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:52:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:52:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:52:07 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-14 13:52:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 13:52:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 13:52:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 13:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:53:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:53:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:53:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:53:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:53:07 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-01-14 13:53:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 13:53:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 13:53:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 13:54:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 13:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:54:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:54:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:54:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:54:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:54:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:54:07 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-14 13:54:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 13:54:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 13:54:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 13:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:55:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 13:55:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:55:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:55:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:55:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:55:07 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-14 13:55:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 13:55:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 13:55:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 13:55:56 [DEBUG   ] Got command RPT from MCS: ref #1166805
2019-01-14 13:55:56 [DEBUG   ] summary = ERROR
2019-01-14 13:55:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166805  13 58497 50156993 A  ERRORERROR'
2019-01-14 13:55:57 [DEBUG   ] Got command RPT from MCS: ref #1166806
2019-01-14 13:55:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166806  77 58497 50157197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:55:57 [DEBUG   ] Got command RPT from MCS: ref #1166807
2019-01-14 13:55:57 [DEBUG   ] summary = ERROR
2019-01-14 13:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166807  13 58497 50157401 A  ERRORERROR'
2019-01-14 13:55:57 [DEBUG   ] Got command RPT from MCS: ref #1166809
2019-01-14 13:55:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166809  77 58497 50157593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:55:57 [DEBUG   ] Got command RPT from MCS: ref #1166810
2019-01-14 13:55:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 13:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166810  12 58497 50157797 A  ERRORB˜™š'
2019-01-14 13:56:04 [DEBUG   ] Got command RPT from MCS: ref #1166819
2019-01-14 13:56:04 [DEBUG   ] summary = ERROR
2019-01-14 13:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166819  13 58497 50164709 A  ERRORERROR'
2019-01-14 13:56:04 [DEBUG   ] Got command RPT from MCS: ref #1166820
2019-01-14 13:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 13:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166820  77 58497 50164710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 13:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:56:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:56:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:56:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:56:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:56:07 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-14 13:56:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 13:56:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 13:56:55 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 13:57:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:57:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:57:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:57:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:57:07 [WARNING ] (13, 1, 'bot')
2019-01-14 13:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:57:07 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-14 13:57:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 13:57:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 13:57:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 13:58:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 13:58:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:58:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:58:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:58:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:58:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:58:08 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-01-14 13:58:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 13:58:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 13:58:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 13:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 13:59:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:59:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:59:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:59:08 [WARNING ] (13, 1, 'bot')
2019-01-14 13:59:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 13:59:08 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-14 13:59:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 13:59:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 13:59:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:00:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:00:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:00:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:00:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:00:08 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-14 14:00:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 14:00:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 14:00:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 14:00:57 [DEBUG   ] Got command RPT from MCS: ref #1166840
2019-01-14 14:00:57 [DEBUG   ] summary = ERROR
2019-01-14 14:00:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166840  13 58497 50457077 A  ERRORERROR'
2019-01-14 14:00:57 [DEBUG   ] Got command RPT from MCS: ref #1166841
2019-01-14 14:00:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:00:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166841  77 58497 50457281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:00:57 [DEBUG   ] Got command RPT from MCS: ref #1166842
2019-01-14 14:00:57 [DEBUG   ] summary = ERROR
2019-01-14 14:00:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166842  13 58497 50457485 A  ERRORERROR'
2019-01-14 14:00:57 [DEBUG   ] Got command RPT from MCS: ref #1166843
2019-01-14 14:00:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:00:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166843  77 58497 50457677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:00:57 [DEBUG   ] Got command RPT from MCS: ref #1166844
2019-01-14 14:00:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:00:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166844  12 58497 50457881 A  ERRORB˜™š'
2019-01-14 14:01:04 [DEBUG   ] Got command RPT from MCS: ref #1166845
2019-01-14 14:01:04 [DEBUG   ] summary = ERROR
2019-01-14 14:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166845  13 58497 50464709 A  ERRORERROR'
2019-01-14 14:01:04 [DEBUG   ] Got command RPT from MCS: ref #1166846
2019-01-14 14:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166846  77 58497 50464710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:01:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:01:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:01:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:01:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:01:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:01:08 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-14 14:01:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:01:35 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 14:01:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 14:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:02:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:02:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:02:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:02:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:02:08 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-14 14:02:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 14:02:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 14:02:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 14:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:03:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:03:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:03:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:03:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:03:08 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-14 14:03:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 14:03:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:03:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:04:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 14:04:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:04:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:04:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:04:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:04:08 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-14 14:04:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 14:04:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 14:04:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 14:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:05:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:05:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:05:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:05:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:05:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:05:08 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-14 14:05:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 14:05:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 14:05:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:05:57 [DEBUG   ] Got command RPT from MCS: ref #1166872
2019-01-14 14:05:57 [DEBUG   ] summary = ERROR
2019-01-14 14:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166872  13 58497 50757165 A  ERRORERROR'
2019-01-14 14:05:57 [DEBUG   ] Got command RPT from MCS: ref #1166873
2019-01-14 14:05:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166873  77 58497 50757369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:05:57 [DEBUG   ] Got command RPT from MCS: ref #1166874
2019-01-14 14:05:57 [DEBUG   ] summary = ERROR
2019-01-14 14:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166874  13 58497 50757561 A  ERRORERROR'
2019-01-14 14:05:57 [DEBUG   ] Got command RPT from MCS: ref #1166876
2019-01-14 14:05:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166876  77 58497 50757765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:05:57 [DEBUG   ] Got command RPT from MCS: ref #1166878
2019-01-14 14:05:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166878  12 58497 50757969 A  ERRORB˜™š'
2019-01-14 14:06:04 [DEBUG   ] Got command RPT from MCS: ref #1166882
2019-01-14 14:06:04 [DEBUG   ] summary = ERROR
2019-01-14 14:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166882  13 58497 50764713 A  ERRORERROR'
2019-01-14 14:06:04 [DEBUG   ] Got command RPT from MCS: ref #1166883
2019-01-14 14:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166883  77 58497 50764714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:06:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:06:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:06:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:06:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:06:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:06:08 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-01-14 14:06:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 14:06:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 14:06:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 14:07:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:07:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:07:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:07:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:07:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:07:08 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-14 14:07:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 14:07:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:07:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 14:08:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:08:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:08:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:08:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:08:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:08:08 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-14 14:08:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:08:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 14:08:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 14:09:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:09:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:09:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:09:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:09:08 [WARNING ] (13, 1, 'bot')
2019-01-14 14:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:09:08 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-01-14 14:09:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 14:09:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 14:09:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 14:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:10:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:10:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:10:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:10:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:10:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:10:09 [DEBUG   ] Finished updating board flags in 2.207 seconds
2019-01-14 14:10:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 14:10:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 14:10:57 [DEBUG   ] Got command RPT from MCS: ref #1166903
2019-01-14 14:10:57 [DEBUG   ] summary = ERROR
2019-01-14 14:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166903  13 58497 51057253 A  ERRORERROR'
2019-01-14 14:10:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 14:10:57 [DEBUG   ] Got command RPT from MCS: ref #1166904
2019-01-14 14:10:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166904  77 58497 51057457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:10:57 [DEBUG   ] Got command RPT from MCS: ref #1166905
2019-01-14 14:10:57 [DEBUG   ] summary = ERROR
2019-01-14 14:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166905  13 58497 51057661 A  ERRORERROR'
2019-01-14 14:10:57 [DEBUG   ] Got command RPT from MCS: ref #1166906
2019-01-14 14:10:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166906  77 58497 51057853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:10:58 [DEBUG   ] Got command RPT from MCS: ref #1166907
2019-01-14 14:10:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166907  12 58497 51058057 A  ERRORB™™š'
2019-01-14 14:11:04 [DEBUG   ] Got command RPT from MCS: ref #1166912
2019-01-14 14:11:04 [DEBUG   ] summary = ERROR
2019-01-14 14:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166912  13 58497 51064717 A  ERRORERROR'
2019-01-14 14:11:04 [DEBUG   ] Got command RPT from MCS: ref #1166913
2019-01-14 14:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166913  77 58497 51064718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:11:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:11:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:11:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:11:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:11:09 [DEBUG   ] Finished updating board flags in 2.148 seconds
2019-01-14 14:11:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:11:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:11:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 14:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:12:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:12:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:12:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:12:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:12:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:12:09 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-14 14:12:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 14:12:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 14:12:58 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 14:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:13:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:13:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:13:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:13:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:13:09 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-14 14:13:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 14:13:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:13:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 14:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:14:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:14:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:14:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:14:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:14:09 [DEBUG   ] Finished updating board flags in 1.973 seconds
2019-01-14 14:14:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 14:14:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 14:14:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 14:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:15:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:15:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:15:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:15:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:15:09 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-14 14:15:18 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2019-01-14 14:15:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 14:15:57 [DEBUG   ] Got command RPT from MCS: ref #1166935
2019-01-14 14:15:57 [DEBUG   ] summary = ERROR
2019-01-14 14:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166935  13 58497 51357333 A  ERRORERROR'
2019-01-14 14:15:57 [DEBUG   ] Got command RPT from MCS: ref #1166936
2019-01-14 14:15:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166936  77 58497 51357537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:15:57 [DEBUG   ] Got command RPT from MCS: ref #1166937
2019-01-14 14:15:57 [DEBUG   ] summary = ERROR
2019-01-14 14:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166937  13 58497 51357742 A  ERRORERROR'
2019-01-14 14:15:57 [DEBUG   ] Got command RPT from MCS: ref #1166939
2019-01-14 14:15:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166939  77 58497 51357945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:15:58 [DEBUG   ] Got command RPT from MCS: ref #1166940
2019-01-14 14:15:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166940  12 58497 51358137 A  ERRORB˜™š'
2019-01-14 14:15:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:16:04 [DEBUG   ] Got command RPT from MCS: ref #1166945
2019-01-14 14:16:04 [DEBUG   ] summary = ERROR
2019-01-14 14:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166945  13 58497 51364713 A  ERRORERROR'
2019-01-14 14:16:04 [DEBUG   ] Got command RPT from MCS: ref #1166946
2019-01-14 14:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166946  77 58497 51364714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:16:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 14:16:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:16:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:16:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:16:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:16:09 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-14 14:16:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:16:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 14:16:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 14:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:17:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:17:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:17:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:17:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:17:09 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-01-14 14:17:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 14:17:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 14:17:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 14:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:18:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 14:18:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:18:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:18:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:18:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:18:09 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-14 14:18:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:18:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 14:18:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 14:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:19:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:19:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:19:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:19:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:19:09 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-14 14:19:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 14:19:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:19:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 14:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:20:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:20:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:20:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:20:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:20:09 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-01-14 14:20:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 14:20:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 14:20:57 [DEBUG   ] Got command RPT from MCS: ref #1166970
2019-01-14 14:20:57 [DEBUG   ] summary = ERROR
2019-01-14 14:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166970  13 58497 51657421 A  ERRORERROR'
2019-01-14 14:20:57 [DEBUG   ] Got command RPT from MCS: ref #1166971
2019-01-14 14:20:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166971  77 58497 51657625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:20:57 [DEBUG   ] Got command RPT from MCS: ref #1166972
2019-01-14 14:20:57 [DEBUG   ] summary = ERROR
2019-01-14 14:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166972  13 58497 51657829 A  ERRORERROR'
2019-01-14 14:20:58 [DEBUG   ] Got command RPT from MCS: ref #1166973
2019-01-14 14:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166973  77 58497 51658021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:20:58 [DEBUG   ] Got command RPT from MCS: ref #1166974
2019-01-14 14:20:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166974  12 58497 51658225 A  ERRORB™™š'
2019-01-14 14:20:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 14:21:04 [DEBUG   ] Got command RPT from MCS: ref #1166975
2019-01-14 14:21:04 [DEBUG   ] summary = ERROR
2019-01-14 14:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166975  13 58497 51664717 A  ERRORERROR'
2019-01-14 14:21:04 [DEBUG   ] Got command RPT from MCS: ref #1166976
2019-01-14 14:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166976  77 58497 51664718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:21:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:21:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:21:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:21:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:21:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:21:09 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-14 14:21:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 14:21:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 14:21:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:22:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 14:22:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:22:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:22:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:22:09 [WARNING ] (13, 1, 'bot')
2019-01-14 14:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:22:09 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-01-14 14:22:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:22:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 14:22:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 14:23:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:23:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 14:23:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:23:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:23:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:23:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:23:10 [DEBUG   ] Finished updating board flags in 2.035 seconds
2019-01-14 14:23:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 14:23:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:23:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 14:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:24:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:24:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:24:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:24:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:24:10 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-14 14:24:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 14:24:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 14:25:00 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-14 14:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:25:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:25:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:25:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:25:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:25:10 [DEBUG   ] Finished updating board flags in 1.960 seconds
2019-01-14 14:25:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 14:25:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 14:25:57 [DEBUG   ] Got command RPT from MCS: ref #1166998
2019-01-14 14:25:57 [DEBUG   ] summary = ERROR
2019-01-14 14:25:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166998  13 58497 51957501 A  ERRORERROR'
2019-01-14 14:25:57 [DEBUG   ] Got command RPT from MCS: ref #1166999
2019-01-14 14:25:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:25:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1166999  77 58497 51957705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:25:57 [DEBUG   ] Got command RPT from MCS: ref #1167000
2019-01-14 14:25:57 [DEBUG   ] summary = ERROR
2019-01-14 14:25:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167000  13 58497 51957909 A  ERRORERROR'
2019-01-14 14:25:58 [DEBUG   ] Got command RPT from MCS: ref #1167002
2019-01-14 14:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167002  77 58497 51958113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:25:58 [DEBUG   ] Got command RPT from MCS: ref #1167003
2019-01-14 14:25:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167003  12 58497 51958305 A  ERRORB˜™š'
2019-01-14 14:26:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:26:04 [DEBUG   ] Got command RPT from MCS: ref #1167012
2019-01-14 14:26:04 [DEBUG   ] summary = ERROR
2019-01-14 14:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167012  13 58497 51964717 A  ERRORERROR'
2019-01-14 14:26:04 [DEBUG   ] Got command RPT from MCS: ref #1167013
2019-01-14 14:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167013  77 58497 51964718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:26:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:26:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:26:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:26:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:26:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:26:10 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-14 14:26:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 14:26:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 14:27:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:27:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:27:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 14:27:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:27:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:27:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:27:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:27:10 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-14 14:27:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 14:27:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 14:28:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 14:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:28:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:28:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:28:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:28:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:28:10 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-01-14 14:28:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:28:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:29:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 14:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:29:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:29:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:29:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:29:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:29:10 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-14 14:29:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 14:29:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:30:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:30:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:30:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:30:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:30:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:30:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:30:10 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-14 14:30:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 14:30:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 14:30:57 [DEBUG   ] Got command RPT from MCS: ref #1167033
2019-01-14 14:30:57 [DEBUG   ] summary = ERROR
2019-01-14 14:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167033  13 58497 52257593 A  ERRORERROR'
2019-01-14 14:30:57 [DEBUG   ] Got command RPT from MCS: ref #1167034
2019-01-14 14:30:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167034  77 58497 52257797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:30:57 [DEBUG   ] Got command RPT from MCS: ref #1167035
2019-01-14 14:30:57 [DEBUG   ] summary = ERROR
2019-01-14 14:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167035  13 58497 52257989 A  ERRORERROR'
2019-01-14 14:30:58 [DEBUG   ] Got command RPT from MCS: ref #1167036
2019-01-14 14:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167036  77 58497 52258193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:30:58 [DEBUG   ] Got command RPT from MCS: ref #1167037
2019-01-14 14:30:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167037  12 58497 52258397 A  ERRORB˜™š'
2019-01-14 14:31:01 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-01-14 14:31:04 [DEBUG   ] Got command RPT from MCS: ref #1167038
2019-01-14 14:31:04 [DEBUG   ] summary = ERROR
2019-01-14 14:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167038  13 58497 52264717 A  ERRORERROR'
2019-01-14 14:31:04 [DEBUG   ] Got command RPT from MCS: ref #1167039
2019-01-14 14:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167039  77 58497 52264718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:31:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:31:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:31:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:31:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:31:10 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-14 14:31:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 14:31:40 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-14 14:32:01 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 14:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:32:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:32:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:32:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:32:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:32:10 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-01-14 14:32:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 14:32:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:33:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 14:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:33:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:33:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:33:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:33:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:33:10 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-01-14 14:33:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:33:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:34:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 14:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:34:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:34:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:34:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:34:10 [WARNING ] (13, 1, 'bot')
2019-01-14 14:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:34:10 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-14 14:34:21 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-14 14:34:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:35:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 14:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:35:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:35:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:35:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:35:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:35:11 [DEBUG   ] Finished updating board flags in 2.242 seconds
2019-01-14 14:35:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 14:35:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 14:35:57 [DEBUG   ] Got command RPT from MCS: ref #1167065
2019-01-14 14:35:57 [DEBUG   ] summary = ERROR
2019-01-14 14:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167065  13 58497 52557673 A  ERRORERROR'
2019-01-14 14:35:57 [DEBUG   ] Got command RPT from MCS: ref #1167066
2019-01-14 14:35:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167066  77 58497 52557877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:35:58 [DEBUG   ] Got command RPT from MCS: ref #1167067
2019-01-14 14:35:58 [DEBUG   ] summary = ERROR
2019-01-14 14:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167067  13 58497 52558081 A  ERRORERROR'
2019-01-14 14:35:58 [DEBUG   ] Got command RPT from MCS: ref #1167069
2019-01-14 14:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167069  77 58497 52558285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:35:58 [DEBUG   ] Got command RPT from MCS: ref #1167071
2019-01-14 14:35:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167071  12 58497 52558477 A  ERRORB˜™š'
2019-01-14 14:36:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:36:04 [DEBUG   ] Got command RPT from MCS: ref #1167075
2019-01-14 14:36:04 [DEBUG   ] summary = ERROR
2019-01-14 14:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167075  13 58497 52564721 A  ERRORERROR'
2019-01-14 14:36:04 [DEBUG   ] Got command RPT from MCS: ref #1167076
2019-01-14 14:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167076  77 58497 52564722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:36:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:36:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:36:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:36:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:36:11 [DEBUG   ] Finished updating board flags in 2.146 seconds
2019-01-14 14:36:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:36:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:37:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 14:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:37:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:37:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:37:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:37:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:37:11 [DEBUG   ] Finished updating board flags in 2.076 seconds
2019-01-14 14:37:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 14:37:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 14:38:02 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-14 14:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:38:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:38:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:38:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:38:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:38:11 [DEBUG   ] Finished updating board flags in 1.921 seconds
2019-01-14 14:38:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 14:38:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:39:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 14:39:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:39:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:39:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:39:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:39:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:39:11 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-14 14:39:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 14:39:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 14:40:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 14:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:40:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:40:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:40:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:40:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:40:11 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-01-14 14:40:22 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-14 14:40:42 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-14 14:40:57 [DEBUG   ] Got command RPT from MCS: ref #1167096
2019-01-14 14:40:57 [DEBUG   ] summary = ERROR
2019-01-14 14:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167096  13 58497 52857761 A  ERRORERROR'
2019-01-14 14:40:57 [DEBUG   ] Got command RPT from MCS: ref #1167097
2019-01-14 14:40:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167097  77 58497 52857965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:40:58 [DEBUG   ] Got command RPT from MCS: ref #1167098
2019-01-14 14:40:58 [DEBUG   ] summary = ERROR
2019-01-14 14:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167098  13 58497 52858169 A  ERRORERROR'
2019-01-14 14:40:58 [DEBUG   ] Got command RPT from MCS: ref #1167099
2019-01-14 14:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167099  77 58497 52858361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:40:58 [DEBUG   ] Got command RPT from MCS: ref #1167100
2019-01-14 14:40:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167100  12 58497 52858565 A  ERRORB™™š'
2019-01-14 14:41:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:41:04 [DEBUG   ] Got command RPT from MCS: ref #1167105
2019-01-14 14:41:04 [DEBUG   ] summary = ERROR
2019-01-14 14:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167105  13 58497 52864721 A  ERRORERROR'
2019-01-14 14:41:04 [DEBUG   ] Got command RPT from MCS: ref #1167106
2019-01-14 14:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167106  77 58497 52864722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:41:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:41:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 14:41:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:41:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:41:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:41:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:41:11 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-14 14:41:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:41:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:42:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 14:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:42:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:42:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:42:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:42:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:42:11 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-14 14:42:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 14:42:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 14:43:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 14:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:43:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:43:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:43:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:43:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:43:11 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-14 14:43:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 14:43:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 14:44:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 14:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 14:44:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:44:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:44:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:44:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:44:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:44:11 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-14 14:44:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:44:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:45:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 14:45:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:45:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:45:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:45:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:45:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:45:11 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-14 14:45:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 14:45:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:45:57 [DEBUG   ] Got command RPT from MCS: ref #1167128
2019-01-14 14:45:57 [DEBUG   ] summary = ERROR
2019-01-14 14:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167128  13 58497 53157845 A  ERRORERROR'
2019-01-14 14:45:58 [DEBUG   ] Got command RPT from MCS: ref #1167129
2019-01-14 14:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167129  77 58497 53158049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:45:58 [DEBUG   ] Got command RPT from MCS: ref #1167130
2019-01-14 14:45:58 [DEBUG   ] summary = ERROR
2019-01-14 14:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167130  13 58497 53158253 A  ERRORERROR'
2019-01-14 14:45:58 [DEBUG   ] Got command RPT from MCS: ref #1167132
2019-01-14 14:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167132  77 58497 53158445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:45:58 [DEBUG   ] Got command RPT from MCS: ref #1167133
2019-01-14 14:45:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167133  12 58497 53158649 A  ERRORB™™š'
2019-01-14 14:46:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 14:46:04 [DEBUG   ] Got command RPT from MCS: ref #1167138
2019-01-14 14:46:04 [DEBUG   ] summary = ERROR
2019-01-14 14:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167138  13 58497 53164721 A  ERRORERROR'
2019-01-14 14:46:04 [DEBUG   ] Got command RPT from MCS: ref #1167139
2019-01-14 14:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167139  77 58497 53164722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:46:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:46:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:46:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:46:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:46:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:46:11 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-14 14:46:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 14:46:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 14:47:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 14:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:47:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:47:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:47:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:47:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:47:12 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-14 14:47:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 14:47:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 14:48:00 [DEBUG   ] Got command TBN from MCS: ref #1167159
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-14 14:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1167159   8 58497 53280830 A  ERROR'
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547477282']
2019-01-14 14:48:00 [DEBUG   ] spawn_process: at 2019-01-14 14:48:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547477282']
2019-01-14 14:48:00 [INFO    ] Finished spawning TBN in 0.054 s
2019-01-14 14:48:03 [DEBUG   ] Finished updating ant stats in 0.533 seconds
2019-01-14 14:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:48:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:48:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:48:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:48:11 [WARNING ] (13, 1, 'bot')
2019-01-14 14:48:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:48:11 [DEBUG   ] Finished updating board flags in 1.349 seconds
2019-01-14 14:48:23 [DEBUG   ] Finished updating ant stats in 0.467 seconds
2019-01-14 14:48:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 14:49:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 14:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:49:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:49:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:49:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:49:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:49:12 [DEBUG   ] Finished updating board flags in 2.067 seconds
2019-01-14 14:49:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 14:49:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 14:50:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 14:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:50:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:50:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:50:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:50:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:50:12 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-14 14:50:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 14:50:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 14:50:57 [DEBUG   ] Got command RPT from MCS: ref #1167164
2019-01-14 14:50:57 [DEBUG   ] summary = ERROR
2019-01-14 14:50:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167164  13 58497 53457933 A  ERRORERROR'
2019-01-14 14:50:58 [DEBUG   ] Got command RPT from MCS: ref #1167165
2019-01-14 14:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167165  77 58497 53458137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:50:58 [DEBUG   ] Got command RPT from MCS: ref #1167166
2019-01-14 14:50:58 [DEBUG   ] summary = ERROR
2019-01-14 14:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167166  13 58497 53458341 A  ERRORERROR'
2019-01-14 14:50:58 [DEBUG   ] Got command RPT from MCS: ref #1167167
2019-01-14 14:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167167  77 58497 53458533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:50:58 [DEBUG   ] Got command RPT from MCS: ref #1167168
2019-01-14 14:50:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167168  12 58497 53458737 A  ERRORB˜™š'
2019-01-14 14:51:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 14:51:04 [DEBUG   ] Got command RPT from MCS: ref #1167169
2019-01-14 14:51:04 [DEBUG   ] summary = ERROR
2019-01-14 14:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167169  13 58497 53464717 A  ERRORERROR'
2019-01-14 14:51:04 [DEBUG   ] Got command RPT from MCS: ref #1167170
2019-01-14 14:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167170  77 58497 53464718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:51:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:51:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:51:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:51:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:51:12 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-14 14:51:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 14:51:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 14:52:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 14:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:52:11 [DEBUG   ] Got command TBW from MCS: ref #1167187
2019-01-14 14:52:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-14 14:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1167187   8 58497 53531918 A  ERROR'
2019-01-14 14:52:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:52:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:52:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:52:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:52:12 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-14 14:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-14 14:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-14 14:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-14 14:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-14 14:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-14 14:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-14 14:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-14 14:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-14 14:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-14 14:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-14 14:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-14 14:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-14 14:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-14 14:52:15 [DEBUG   ] spawn_process: at 2019-01-14 14:52:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-14 14:52:15 [INFO    ] Finished spawning TBW
2019-01-14 14:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 14:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:53:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:53:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:53:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:53:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:53:12 [DEBUG   ] Finished updating board flags in 1.749 seconds
2019-01-14 14:54:03 [INFO    ] __waitForTBW - TBW finished in 108.455 s
2019-01-14 14:54:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 14:54:04 [INFO    ] Started antennas statistics background thread
2019-01-14 14:54:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547477646']
2019-01-14 14:54:04 [DEBUG   ] spawn_process: at 2019-01-14 14:54:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547477646']
2019-01-14 14:54:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-14 14:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:54:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:54:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:54:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:54:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:54:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:54:12 [DEBUG   ] Finished updating board flags in 1.767 seconds
2019-01-14 14:54:24 [DEBUG   ] Finished updating ant stats in 0.471 seconds
2019-01-14 14:54:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 14:55:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 14:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:55:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 14:55:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:55:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:55:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:55:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:55:12 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-14 14:55:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 14:55:44 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-14 14:55:58 [DEBUG   ] Got command RPT from MCS: ref #1167201
2019-01-14 14:55:58 [DEBUG   ] summary = ERROR
2019-01-14 14:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167201  13 58497 53758021 A  ERRORERROR'
2019-01-14 14:55:58 [DEBUG   ] Got command RPT from MCS: ref #1167202
2019-01-14 14:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167202  77 58497 53758225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:55:58 [DEBUG   ] Got command RPT from MCS: ref #1167203
2019-01-14 14:55:58 [DEBUG   ] summary = ERROR
2019-01-14 14:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167203  13 58497 53758417 A  ERRORERROR'
2019-01-14 14:55:58 [DEBUG   ] Got command RPT from MCS: ref #1167205
2019-01-14 14:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167205  77 58497 53758621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:55:58 [DEBUG   ] Got command RPT from MCS: ref #1167206
2019-01-14 14:55:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 14:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167206  12 58497 53758825 A  ERRORB™™š'
2019-01-14 14:56:04 [DEBUG   ] Got command RPT from MCS: ref #1167215
2019-01-14 14:56:04 [DEBUG   ] summary = ERROR
2019-01-14 14:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167215  13 58497 53764717 A  ERRORERROR'
2019-01-14 14:56:04 [DEBUG   ] Got command RPT from MCS: ref #1167216
2019-01-14 14:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 14:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167216  77 58497 53764718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 14:56:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 14:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:56:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:56:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:56:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:56:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:56:12 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-14 14:56:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 14:56:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 14:57:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 14:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:57:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:57:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:57:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:57:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:57:12 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-14 14:57:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 14:57:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 14:58:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:58:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:58:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:58:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:58:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:58:12 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-14 14:58:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 14:58:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 14:59:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 14:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 14:59:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:59:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:59:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:59:12 [WARNING ] (13, 1, 'bot')
2019-01-14 14:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 14:59:12 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-14 14:59:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 14:59:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:00:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 15:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:00:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:00:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:00:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:00:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:00:12 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-14 15:00:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 15:00:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 15:00:58 [DEBUG   ] Got command RPT from MCS: ref #1167236
2019-01-14 15:00:58 [DEBUG   ] summary = ERROR
2019-01-14 15:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167236  13 58497 54058109 A  ERRORERROR'
2019-01-14 15:00:58 [DEBUG   ] Got command RPT from MCS: ref #1167237
2019-01-14 15:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167237  77 58497 54058313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:00:58 [DEBUG   ] Got command RPT from MCS: ref #1167238
2019-01-14 15:00:58 [DEBUG   ] summary = ERROR
2019-01-14 15:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167238  13 58497 54058505 A  ERRORERROR'
2019-01-14 15:00:58 [DEBUG   ] Got command RPT from MCS: ref #1167239
2019-01-14 15:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167239  77 58497 54058709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:00:58 [DEBUG   ] Got command RPT from MCS: ref #1167240
2019-01-14 15:00:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167240  12 58497 54058913 A  ERRORB˜™š'
2019-01-14 15:01:04 [DEBUG   ] Got command RPT from MCS: ref #1167241
2019-01-14 15:01:04 [DEBUG   ] summary = ERROR
2019-01-14 15:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167241  13 58497 54064721 A  ERRORERROR'
2019-01-14 15:01:04 [DEBUG   ] Got command RPT from MCS: ref #1167242
2019-01-14 15:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167242  77 58497 54064722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:01:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 15:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:01:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:01:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:01:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:01:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:01:12 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-14 15:01:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-01-14 15:01:46 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-14 15:02:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 15:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:02:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:02:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:02:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:02:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:02:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:02:12 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-01-14 15:02:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 15:02:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 15:03:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 15:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:03:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:03:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:03:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:03:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:03:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:03:12 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-01-14 15:03:26 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-14 15:03:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 15:04:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 15:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:04:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:04:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:04:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:04:12 [WARNING ] (13, 1, 'bot')
2019-01-14 15:04:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:04:12 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-14 15:04:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 15:04:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:05:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 15:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:05:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:05:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:05:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:05:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:05:13 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-14 15:05:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 15:05:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 15:05:58 [DEBUG   ] Got command RPT from MCS: ref #1167268
2019-01-14 15:05:58 [DEBUG   ] summary = ERROR
2019-01-14 15:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167268  13 58497 54358189 A  ERRORERROR'
2019-01-14 15:05:58 [DEBUG   ] Got command RPT from MCS: ref #1167269
2019-01-14 15:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167269  77 58497 54358393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:05:58 [DEBUG   ] Got command RPT from MCS: ref #1167270
2019-01-14 15:05:58 [DEBUG   ] summary = ERROR
2019-01-14 15:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167270  13 58497 54358585 A  ERRORERROR'
2019-01-14 15:05:58 [DEBUG   ] Got command RPT from MCS: ref #1167272
2019-01-14 15:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167272  77 58497 54358789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:05:58 [DEBUG   ] Got command RPT from MCS: ref #1167273
2019-01-14 15:05:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167273  12 58497 54358993 A  ERRORB˜™š'
2019-01-14 15:06:04 [DEBUG   ] Got command RPT from MCS: ref #1167278
2019-01-14 15:06:04 [DEBUG   ] summary = ERROR
2019-01-14 15:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167278  13 58497 54364729 A  ERRORERROR'
2019-01-14 15:06:04 [DEBUG   ] Got command RPT from MCS: ref #1167279
2019-01-14 15:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167279  77 58497 54364730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:06:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 15:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:06:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:06:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:06:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:06:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:06:13 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-14 15:06:27 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2019-01-14 15:06:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 15:07:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 15:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 15:07:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:07:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:07:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:07:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:07:13 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-14 15:07:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 15:07:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 15:08:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 15:08:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 15:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 15:08:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:08:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:08:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:08:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:08:13 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-14 15:08:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:08:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 15:09:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 15:09:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:09:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:09:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:09:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:09:13 [DEBUG   ] Finished updating board flags in 2.332 seconds
2019-01-14 15:09:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:09:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 15:10:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 15:10:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:10:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:10:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:10:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:10:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:10:13 [DEBUG   ] Finished updating board flags in 2.067 seconds
2019-01-14 15:10:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 15:10:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 15:10:58 [DEBUG   ] Got command RPT from MCS: ref #1167309
2019-01-14 15:10:58 [DEBUG   ] summary = ERROR
2019-01-14 15:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167309  13 58497 54658277 A  ERRORERROR'
2019-01-14 15:10:58 [DEBUG   ] Got command RPT from MCS: ref #1167310
2019-01-14 15:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167310  77 58497 54658469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:10:58 [DEBUG   ] Got command RPT from MCS: ref #1167311
2019-01-14 15:10:58 [DEBUG   ] summary = ERROR
2019-01-14 15:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167311  13 58497 54658673 A  ERRORERROR'
2019-01-14 15:10:58 [DEBUG   ] Got command RPT from MCS: ref #1167312
2019-01-14 15:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167312  77 58497 54658877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:10:59 [DEBUG   ] Got command RPT from MCS: ref #1167313
2019-01-14 15:10:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167313  12 58497 54659081 A  ERRORB˜™š'
2019-01-14 15:11:04 [DEBUG   ] Got command RPT from MCS: ref #1167318
2019-01-14 15:11:04 [DEBUG   ] summary = ERROR
2019-01-14 15:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167318  13 58497 54664721 A  ERRORERROR'
2019-01-14 15:11:04 [DEBUG   ] Got command RPT from MCS: ref #1167319
2019-01-14 15:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167319  77 58497 54664722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:11:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 15:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:11:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:11:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:11:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:11:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:11:13 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-14 15:11:27 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-14 15:11:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 15:12:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 15:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:12:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:12:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:12:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:12:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:12:13 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-14 15:12:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 15:12:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 15:13:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 15:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:13:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:13:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:13:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:13:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:13:13 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-14 15:13:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 15:13:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 15:14:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 15:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:14:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:14:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:14:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:14:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:14:13 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-14 15:14:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 15:14:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 15:15:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 15:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 15:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 15:15:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:15:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:15:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:15:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:15:13 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-14 15:15:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 15:15:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 15:15:58 [DEBUG   ] Got command RPT from MCS: ref #1167341
2019-01-14 15:15:58 [DEBUG   ] summary = ERROR
2019-01-14 15:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167341  13 58497 54958353 A  ERRORERROR'
2019-01-14 15:15:58 [DEBUG   ] Got command RPT from MCS: ref #1167342
2019-01-14 15:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167342  77 58497 54958557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:15:58 [DEBUG   ] Got command RPT from MCS: ref #1167343
2019-01-14 15:15:58 [DEBUG   ] summary = ERROR
2019-01-14 15:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167343  13 58497 54958761 A  ERRORERROR'
2019-01-14 15:15:58 [DEBUG   ] Got command RPT from MCS: ref #1167344
2019-01-14 15:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167344  77 58497 54958965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:15:59 [DEBUG   ] Got command RPT from MCS: ref #1167346
2019-01-14 15:15:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167346  12 58497 54959157 A  ERRORB™™š'
2019-01-14 15:16:04 [DEBUG   ] Got command RPT from MCS: ref #1167351
2019-01-14 15:16:04 [DEBUG   ] summary = ERROR
2019-01-14 15:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167351  13 58497 54964725 A  ERRORERROR'
2019-01-14 15:16:04 [DEBUG   ] Got command RPT from MCS: ref #1167352
2019-01-14 15:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167352  77 58497 54964726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:16:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:16:13 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-14 15:16:28 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-14 15:16:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:17:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 15:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 15:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:17:13 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-14 15:17:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 15:17:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 15:18:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 15:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:18:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:18:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:18:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:18:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:18:14 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-01-14 15:18:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 15:18:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 15:19:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 15:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:19:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:19:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:19:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:19:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:19:14 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-01-14 15:19:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 15:19:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:20:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 15:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:20:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 15:20:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:20:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:20:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:20:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:20:14 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-14 15:20:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 15:20:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:20:58 [DEBUG   ] Got command RPT from MCS: ref #1167376
2019-01-14 15:20:58 [DEBUG   ] summary = ERROR
2019-01-14 15:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167376  13 58497 55258449 A  ERRORERROR'
2019-01-14 15:20:58 [DEBUG   ] Got command RPT from MCS: ref #1167377
2019-01-14 15:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167377  77 58497 55258641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:20:58 [DEBUG   ] Got command RPT from MCS: ref #1167378
2019-01-14 15:20:58 [DEBUG   ] summary = ERROR
2019-01-14 15:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167378  13 58497 55258845 A  ERRORERROR'
2019-01-14 15:20:59 [DEBUG   ] Got command RPT from MCS: ref #1167379
2019-01-14 15:20:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167379  77 58497 55259049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:20:59 [DEBUG   ] Got command RPT from MCS: ref #1167380
2019-01-14 15:20:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167380  12 58497 55259241 A  ERRORB™™š'
2019-01-14 15:21:04 [DEBUG   ] Got command RPT from MCS: ref #1167381
2019-01-14 15:21:04 [DEBUG   ] summary = ERROR
2019-01-14 15:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167381  13 58497 55264733 A  ERRORERROR'
2019-01-14 15:21:04 [DEBUG   ] Got command RPT from MCS: ref #1167382
2019-01-14 15:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167382  77 58497 55264734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:21:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 15:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:21:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:21:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:21:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:21:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:21:14 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-14 15:21:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 15:21:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 15:22:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 15:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:22:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:22:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:22:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:22:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:22:14 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-14 15:22:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:22:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 15:23:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-14 15:23:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:23:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:23:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:23:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:23:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:23:14 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-14 15:23:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 15:23:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 15:24:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 15:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:24:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:24:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:24:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:24:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:24:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:24:14 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-14 15:24:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:24:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:25:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 15:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:25:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:25:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:25:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:25:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:25:14 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-14 15:25:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:25:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 15:25:58 [DEBUG   ] Got command RPT from MCS: ref #1167404
2019-01-14 15:25:58 [DEBUG   ] summary = ERROR
2019-01-14 15:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167404  13 58497 55558537 A  ERRORERROR'
2019-01-14 15:25:58 [DEBUG   ] Got command RPT from MCS: ref #1167405
2019-01-14 15:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167405  77 58497 55558729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:25:58 [DEBUG   ] Got command RPT from MCS: ref #1167406
2019-01-14 15:25:58 [DEBUG   ] summary = ERROR
2019-01-14 15:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167406  13 58497 55558933 A  ERRORERROR'
2019-01-14 15:25:59 [DEBUG   ] Got command RPT from MCS: ref #1167408
2019-01-14 15:25:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167408  77 58497 55559137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:25:59 [DEBUG   ] Got command RPT from MCS: ref #1167410
2019-01-14 15:25:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167410  12 58497 55559329 A  ERRORB˜™š'
2019-01-14 15:26:04 [DEBUG   ] Got command RPT from MCS: ref #1167418
2019-01-14 15:26:04 [DEBUG   ] summary = ERROR
2019-01-14 15:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167418  13 58497 55564729 A  ERRORERROR'
2019-01-14 15:26:04 [DEBUG   ] Got command RPT from MCS: ref #1167419
2019-01-14 15:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167419  77 58497 55564730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:26:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 15:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:26:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:26:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:26:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:26:14 [WARNING ] (13, 1, 'bot')
2019-01-14 15:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:26:14 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-14 15:26:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 15:26:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 15:27:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:27:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:27:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:27:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:27:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:27:15 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-01-14 15:27:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 15:27:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 15:28:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 15:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 15:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:28:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:28:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:28:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:28:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:28:15 [DEBUG   ] Finished updating board flags in 2.182 seconds
2019-01-14 15:28:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 15:28:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 15:29:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 15:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 15:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:29:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:29:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:29:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:29:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:29:15 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-14 15:29:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 15:29:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 15:30:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 15:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:30:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:30:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:30:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:30:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:30:15 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-14 15:30:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:30:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 15:30:58 [DEBUG   ] Got command RPT from MCS: ref #1167439
2019-01-14 15:30:58 [DEBUG   ] summary = ERROR
2019-01-14 15:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167439  13 58497 55858617 A  ERRORERROR'
2019-01-14 15:30:58 [DEBUG   ] Got command RPT from MCS: ref #1167440
2019-01-14 15:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167440  77 58497 55858821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:30:59 [DEBUG   ] Got command RPT from MCS: ref #1167441
2019-01-14 15:30:59 [DEBUG   ] summary = ERROR
2019-01-14 15:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167441  13 58497 55859025 A  ERRORERROR'
2019-01-14 15:30:59 [DEBUG   ] Got command RPT from MCS: ref #1167442
2019-01-14 15:30:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167442  77 58497 55859217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:30:59 [DEBUG   ] Got command RPT from MCS: ref #1167443
2019-01-14 15:30:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167443  12 58497 55859421 A  ERRORB™™š'
2019-01-14 15:31:04 [DEBUG   ] Got command RPT from MCS: ref #1167444
2019-01-14 15:31:04 [DEBUG   ] summary = ERROR
2019-01-14 15:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167444  13 58497 55864725 A  ERRORERROR'
2019-01-14 15:31:04 [DEBUG   ] Got command RPT from MCS: ref #1167445
2019-01-14 15:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167445  77 58497 55864726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:31:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 15:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 15:31:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:31:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:31:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:31:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:31:15 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-14 15:31:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:31:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:32:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 15:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:32:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:32:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:32:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:32:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:32:15 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-14 15:32:31 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-14 15:32:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 15:33:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:33:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:33:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:33:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:33:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:33:15 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-14 15:33:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 15:33:52 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2019-01-14 15:34:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 15:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:34:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:34:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:34:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:34:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:34:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:34:15 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-14 15:34:32 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2019-01-14 15:34:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 15:35:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 15:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:35:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:35:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:35:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:35:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:35:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:35:15 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-14 15:35:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 15:35:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 15:35:58 [DEBUG   ] Got command RPT from MCS: ref #1167471
2019-01-14 15:35:58 [DEBUG   ] summary = ERROR
2019-01-14 15:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167471  13 58497 56158709 A  ERRORERROR'
2019-01-14 15:35:58 [DEBUG   ] Got command RPT from MCS: ref #1167472
2019-01-14 15:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167472  77 58497 56158901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:35:59 [DEBUG   ] Got command RPT from MCS: ref #1167473
2019-01-14 15:35:59 [DEBUG   ] summary = ERROR
2019-01-14 15:35:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167473  13 58497 56159105 A  ERRORERROR'
2019-01-14 15:35:59 [DEBUG   ] Got command RPT from MCS: ref #1167475
2019-01-14 15:35:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:35:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167475  77 58497 56159309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:35:59 [DEBUG   ] Got command RPT from MCS: ref #1167476
2019-01-14 15:35:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:35:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167476  12 58497 56159513 A  ERRORB˜™š'
2019-01-14 15:36:04 [DEBUG   ] Got command RPT from MCS: ref #1167481
2019-01-14 15:36:04 [DEBUG   ] summary = ERROR
2019-01-14 15:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167481  13 58497 56164733 A  ERRORERROR'
2019-01-14 15:36:04 [DEBUG   ] Got command RPT from MCS: ref #1167482
2019-01-14 15:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167482  77 58497 56164734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:36:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 15:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:36:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:36:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:36:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:36:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:36:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:36:15 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-14 15:36:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 15:36:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 15:37:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 15:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:37:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:37:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:37:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:37:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:37:15 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-14 15:37:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 15:37:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 15:38:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:38:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:38:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 15:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:38:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 15:38:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:38:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:38:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:38:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:38:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:38:15 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-14 15:38:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:38:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 15:39:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 15:39:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 15:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:39:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:39:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:39:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:39:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:39:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:39:15 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-14 15:39:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 15:39:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 15:40:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 15:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:40:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:40:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:40:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:40:15 [WARNING ] (13, 1, 'bot')
2019-01-14 15:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:40:15 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-01-14 15:40:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:40:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 15:40:58 [DEBUG   ] Got command RPT from MCS: ref #1167502
2019-01-14 15:40:58 [DEBUG   ] summary = ERROR
2019-01-14 15:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167502  13 58497 56458793 A  ERRORERROR'
2019-01-14 15:40:58 [DEBUG   ] Got command RPT from MCS: ref #1167503
2019-01-14 15:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167503  77 58497 56458997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:40:59 [DEBUG   ] Got command RPT from MCS: ref #1167504
2019-01-14 15:40:59 [DEBUG   ] summary = ERROR
2019-01-14 15:40:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167504  13 58497 56459189 A  ERRORERROR'
2019-01-14 15:40:59 [DEBUG   ] Got command RPT from MCS: ref #1167505
2019-01-14 15:40:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:40:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167505  77 58497 56459393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:40:59 [DEBUG   ] Got command RPT from MCS: ref #1167506
2019-01-14 15:40:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:40:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167506  12 58497 56459597 A  ERRORB˜™š'
2019-01-14 15:41:04 [DEBUG   ] Got command RPT from MCS: ref #1167510
2019-01-14 15:41:04 [DEBUG   ] summary = ERROR
2019-01-14 15:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167510  13 58497 56464733 A  ERRORERROR'
2019-01-14 15:41:04 [DEBUG   ] Got command RPT from MCS: ref #1167511
2019-01-14 15:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167511  77 58497 56464734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:41:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 15:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:41:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:41:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:41:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:41:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:41:16 [DEBUG   ] Finished updating board flags in 2.097 seconds
2019-01-14 15:41:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 15:41:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 15:42:13 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 15:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:42:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:42:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:42:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:42:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:42:16 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-14 15:42:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 15:42:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 15:43:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 15:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:43:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:43:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:43:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:43:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:43:16 [DEBUG   ] Finished updating board flags in 1.927 seconds
2019-01-14 15:43:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:43:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 15:44:14 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 15:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:44:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:44:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:44:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:44:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:44:16 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-01-14 15:44:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 15:44:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 15:45:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 15:45:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:45:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 15:45:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:45:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:45:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:45:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:45:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:45:16 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-14 15:45:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:45:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 15:45:58 [DEBUG   ] Got command RPT from MCS: ref #1167534
2019-01-14 15:45:58 [DEBUG   ] summary = ERROR
2019-01-14 15:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167534  13 58497 56758881 A  ERRORERROR'
2019-01-14 15:45:59 [DEBUG   ] Got command RPT from MCS: ref #1167535
2019-01-14 15:45:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167535  77 58497 56759073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:45:59 [DEBUG   ] Got command RPT from MCS: ref #1167536
2019-01-14 15:45:59 [DEBUG   ] summary = ERROR
2019-01-14 15:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167536  13 58497 56759277 A  ERRORERROR'
2019-01-14 15:45:59 [DEBUG   ] Got command RPT from MCS: ref #1167538
2019-01-14 15:45:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167538  77 58497 56759481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:45:59 [DEBUG   ] Got command RPT from MCS: ref #1167539
2019-01-14 15:45:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167539  12 58497 56759686 A  ERRORB˜™š'
2019-01-14 15:46:04 [DEBUG   ] Got command RPT from MCS: ref #1167544
2019-01-14 15:46:04 [DEBUG   ] summary = ERROR
2019-01-14 15:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167544  13 58497 56764737 A  ERRORERROR'
2019-01-14 15:46:04 [DEBUG   ] Got command RPT from MCS: ref #1167545
2019-01-14 15:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167545  77 58497 56764738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:46:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 15:46:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:46:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:46:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:46:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:46:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:46:16 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-14 15:46:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 15:46:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:47:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 15:47:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:47:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:47:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:47:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:47:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:47:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:47:16 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-14 15:47:34 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-14 15:47:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 15:48:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 15:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:48:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:48:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:48:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:48:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:48:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:48:16 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-14 15:48:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 15:48:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 15:49:15 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2019-01-14 15:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:49:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:49:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:49:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:49:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:49:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:49:16 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-14 15:49:35 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-01-14 15:49:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 15:50:15 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2019-01-14 15:50:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:50:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:50:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:50:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:50:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:50:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:50:16 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-14 15:50:35 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2019-01-14 15:50:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 15:50:58 [DEBUG   ] Got command RPT from MCS: ref #1167569
2019-01-14 15:50:58 [DEBUG   ] summary = ERROR
2019-01-14 15:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167569  13 58497 57058957 A  ERRORERROR'
2019-01-14 15:50:59 [DEBUG   ] Got command RPT from MCS: ref #1167570
2019-01-14 15:50:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:50:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167570  77 58497 57059161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:50:59 [DEBUG   ] Got command RPT from MCS: ref #1167571
2019-01-14 15:50:59 [DEBUG   ] summary = ERROR
2019-01-14 15:50:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167571  13 58497 57059365 A  ERRORERROR'
2019-01-14 15:50:59 [DEBUG   ] Got command RPT from MCS: ref #1167572
2019-01-14 15:50:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:50:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167572  77 58497 57059569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:50:59 [DEBUG   ] Got command RPT from MCS: ref #1167573
2019-01-14 15:50:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:50:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167573  12 58497 57059761 A  ERRORB˜™š'
2019-01-14 15:51:04 [DEBUG   ] Got command RPT from MCS: ref #1167574
2019-01-14 15:51:04 [DEBUG   ] summary = ERROR
2019-01-14 15:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167574  13 58497 57064741 A  ERRORERROR'
2019-01-14 15:51:04 [DEBUG   ] Got command RPT from MCS: ref #1167575
2019-01-14 15:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167575  77 58497 57064742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:51:15 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-14 15:51:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:51:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:51:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:51:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:51:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:51:16 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-14 15:51:35 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2019-01-14 15:51:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 15:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:52:16 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2019-01-14 15:52:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:52:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:52:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:52:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:52:16 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-14 15:52:36 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2019-01-14 15:52:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 15:53:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:53:16 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2019-01-14 15:53:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 15:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:53:16 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-01-14 15:53:36 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-01-14 15:53:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 15:54:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 15:54:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:54:16 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-01-14 15:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:54:16 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-01-14 15:54:36 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-01-14 15:54:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 15:55:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:55:16 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-01-14 15:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 15:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:55:16 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-01-14 15:55:36 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-01-14 15:55:56 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-01-14 15:55:59 [DEBUG   ] Got command RPT from MCS: ref #1167597
2019-01-14 15:55:59 [DEBUG   ] summary = ERROR
2019-01-14 15:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167597  13 58497 57359041 A  ERRORERROR'
2019-01-14 15:55:59 [DEBUG   ] Got command RPT from MCS: ref #1167598
2019-01-14 15:55:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167598  77 58497 57359245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:55:59 [DEBUG   ] Got command RPT from MCS: ref #1167599
2019-01-14 15:55:59 [DEBUG   ] summary = ERROR
2019-01-14 15:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167599  13 58497 57359449 A  ERRORERROR'
2019-01-14 15:55:59 [DEBUG   ] Got command RPT from MCS: ref #1167601
2019-01-14 15:55:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167601  77 58497 57359653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:55:59 [DEBUG   ] Got command RPT from MCS: ref #1167603
2019-01-14 15:55:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 15:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167603  12 58497 57359845 A  ERRORB™™š'
2019-01-14 15:56:04 [DEBUG   ] Got command RPT from MCS: ref #1167609
2019-01-14 15:56:04 [DEBUG   ] summary = ERROR
2019-01-14 15:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167609  13 58497 57364741 A  ERRORERROR'
2019-01-14 15:56:04 [DEBUG   ] Got command RPT from MCS: ref #1167610
2019-01-14 15:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 15:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167610  77 58497 57364742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 15:56:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:56:17 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 15:56:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:56:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:56:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:56:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:56:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:56:17 [DEBUG   ] Finished updating board flags in 2.191 seconds
2019-01-14 15:56:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 15:56:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 15:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:57:17 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-01-14 15:57:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:57:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:57:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:57:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:57:17 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-01-14 15:57:37 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2019-01-14 15:57:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 15:58:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:58:17 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2019-01-14 15:58:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:58:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:58:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:58:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:58:17 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-14 15:58:37 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2019-01-14 15:58:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 15:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 15:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 15:59:17 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2019-01-14 15:59:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:59:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:59:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:59:17 [WARNING ] (13, 1, 'bot')
2019-01-14 15:59:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 15:59:17 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-14 15:59:37 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-14 15:59:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 16:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:00:17 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2019-01-14 16:00:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:00:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:00:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:00:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:00:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:00:17 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-14 16:00:38 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2019-01-14 16:00:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 16:00:59 [DEBUG   ] Got command RPT from MCS: ref #1167632
2019-01-14 16:00:59 [DEBUG   ] summary = ERROR
2019-01-14 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167632  13 58497 57659133 A  ERRORERROR'
2019-01-14 16:00:59 [DEBUG   ] Got command RPT from MCS: ref #1167633
2019-01-14 16:00:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167633  77 58497 57659337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:00:59 [DEBUG   ] Got command RPT from MCS: ref #1167634
2019-01-14 16:00:59 [DEBUG   ] summary = ERROR
2019-01-14 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167634  13 58497 57659529 A  ERRORERROR'
2019-01-14 16:00:59 [DEBUG   ] Got command RPT from MCS: ref #1167635
2019-01-14 16:00:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167635  77 58497 57659733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:00:59 [DEBUG   ] Got command RPT from MCS: ref #1167636
2019-01-14 16:00:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167636  12 58497 57659937 A  ERRORB—™š'
2019-01-14 16:01:04 [DEBUG   ] Got command RPT from MCS: ref #1167637
2019-01-14 16:01:04 [DEBUG   ] summary = ERROR
2019-01-14 16:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167637  13 58497 57664737 A  ERRORERROR'
2019-01-14 16:01:04 [DEBUG   ] Got command RPT from MCS: ref #1167638
2019-01-14 16:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167638  77 58497 57664738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:01:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 16:01:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:01:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:01:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:01:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:01:18 [DEBUG   ] Finished updating board flags in 2.882 seconds
2019-01-14 16:01:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 16:01:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:02:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:02:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:02:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:02:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:02:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:02:17 [DEBUG   ] Finished updating board flags in 1.700 seconds
2019-01-14 16:02:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:02:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:02:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 16:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:03:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:03:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:03:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:03:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:03:17 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-14 16:03:18 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-14 16:03:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 16:03:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:04:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:04:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:04:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:04:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:04:17 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-14 16:04:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:04:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 16:04:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:05:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:05:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:05:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:05:17 [WARNING ] (13, 1, 'bot')
2019-01-14 16:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:05:17 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-14 16:05:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:05:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 16:05:59 [DEBUG   ] Got command RPT from MCS: ref #1167664
2019-01-14 16:05:59 [DEBUG   ] summary = ERROR
2019-01-14 16:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167664  13 58497 57959213 A  ERRORERROR'
2019-01-14 16:05:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 16:05:59 [DEBUG   ] Got command RPT from MCS: ref #1167665
2019-01-14 16:05:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167665  77 58497 57959417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:05:59 [DEBUG   ] Got command RPT from MCS: ref #1167666
2019-01-14 16:05:59 [DEBUG   ] summary = ERROR
2019-01-14 16:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167666  13 58497 57959621 A  ERRORERROR'
2019-01-14 16:05:59 [DEBUG   ] Got command RPT from MCS: ref #1167668
2019-01-14 16:05:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167668  77 58497 57959813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:06:00 [DEBUG   ] Got command RPT from MCS: ref #1167669
2019-01-14 16:06:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:06:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167669  12 58497 57960017 A  ERRORB˜™š'
2019-01-14 16:06:04 [DEBUG   ] Got command RPT from MCS: ref #1167674
2019-01-14 16:06:04 [DEBUG   ] summary = ERROR
2019-01-14 16:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167674  13 58497 57964733 A  ERRORERROR'
2019-01-14 16:06:04 [DEBUG   ] Got command RPT from MCS: ref #1167675
2019-01-14 16:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167675  77 58497 57964734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:06:19 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-01-14 16:06:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:06:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:06:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:06:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:06:19 [DEBUG   ] Finished updating board flags in 3.343 seconds
2019-01-14 16:06:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:06:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:07:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:07:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:07:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:07:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:07:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:07:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:07:18 [DEBUG   ] Finished updating board flags in 2.074 seconds
2019-01-14 16:07:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:07:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:07:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 16:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 16:08:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:08:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:08:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:08:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:08:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:08:18 [DEBUG   ] Finished updating board flags in 2.068 seconds
2019-01-14 16:08:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 16:08:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 16:08:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 16:09:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:09:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:09:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:09:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:09:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:09:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:09:18 [DEBUG   ] Finished updating board flags in 1.924 seconds
2019-01-14 16:09:19 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-14 16:09:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:09:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:10:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:10:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:10:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:10:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:10:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:10:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:10:18 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-14 16:10:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 16:10:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 16:10:59 [DEBUG   ] Got command RPT from MCS: ref #1167695
2019-01-14 16:10:59 [DEBUG   ] summary = ERROR
2019-01-14 16:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167695  13 58497 58259297 A  ERRORERROR'
2019-01-14 16:10:59 [DEBUG   ] Got command RPT from MCS: ref #1167696
2019-01-14 16:10:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167696  77 58497 58259501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:10:59 [DEBUG   ] Got command RPT from MCS: ref #1167697
2019-01-14 16:10:59 [DEBUG   ] summary = ERROR
2019-01-14 16:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167697  13 58497 58259705 A  ERRORERROR'
2019-01-14 16:10:59 [DEBUG   ] Got command RPT from MCS: ref #1167698
2019-01-14 16:10:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167698  77 58497 58259909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:11:00 [DEBUG   ] Got command RPT from MCS: ref #1167699
2019-01-14 16:11:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167699  12 58497 58260101 A  ERRORB˜™š'
2019-01-14 16:11:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 16:11:04 [DEBUG   ] Got command RPT from MCS: ref #1167700
2019-01-14 16:11:04 [DEBUG   ] summary = ERROR
2019-01-14 16:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167700  13 58497 58264745 A  ERRORERROR'
2019-01-14 16:11:04 [DEBUG   ] Got command RPT from MCS: ref #1167701
2019-01-14 16:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167701  77 58497 58264746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:11:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 16:11:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:11:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:11:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 16:11:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:11:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:11:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:11:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:11:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:11:18 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-14 16:11:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 16:11:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:12:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:12:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:12:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:12:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:12:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:12:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:12:18 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-14 16:12:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:12:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 16:13:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 16:13:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:13:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:13:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:13:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:13:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:13:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:13:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:13:18 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-14 16:13:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 16:13:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:14:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 16:14:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 16:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:14:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:14:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:14:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:14:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:14:18 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-01-14 16:14:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 16:14:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 16:15:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 16:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:15:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:15:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:15:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:15:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:15:18 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-14 16:15:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 16:15:41 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 16:15:59 [DEBUG   ] Got command RPT from MCS: ref #1167727
2019-01-14 16:15:59 [DEBUG   ] summary = ERROR
2019-01-14 16:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167727  13 58497 58559389 A  ERRORERROR'
2019-01-14 16:15:59 [DEBUG   ] Got command RPT from MCS: ref #1167728
2019-01-14 16:15:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167728  77 58497 58559593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:15:59 [DEBUG   ] Got command RPT from MCS: ref #1167729
2019-01-14 16:15:59 [DEBUG   ] summary = ERROR
2019-01-14 16:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167729  13 58497 58559785 A  ERRORERROR'
2019-01-14 16:15:59 [DEBUG   ] Got command RPT from MCS: ref #1167731
2019-01-14 16:15:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167731  77 58497 58559989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:16:00 [DEBUG   ] Got command RPT from MCS: ref #1167732
2019-01-14 16:16:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167732  12 58497 58560193 A  ERRORB˜™š'
2019-01-14 16:16:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 16:16:04 [DEBUG   ] Got command RPT from MCS: ref #1167737
2019-01-14 16:16:04 [DEBUG   ] summary = ERROR
2019-01-14 16:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167737  13 58497 58564741 A  ERRORERROR'
2019-01-14 16:16:04 [DEBUG   ] Got command RPT from MCS: ref #1167738
2019-01-14 16:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167738  77 58497 58564742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:16:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 16:16:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:16:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:16:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:16:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:16:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:16:18 [WARNING ] (13, 1, 'bot')
2019-01-14 16:16:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:16:18 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-01-14 16:16:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 16:16:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:17:01 [DEBUG   ] Finished updating ant stats in 1.074 seconds
2019-01-14 16:17:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:17:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:17:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:17:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:17:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:17:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:17:19 [DEBUG   ] Finished updating board flags in 2.231 seconds
2019-01-14 16:17:21 [DEBUG   ] Finished updating ant stats in 0.930 seconds
2019-01-14 16:17:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 16:18:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 16:18:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:18:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:18:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:18:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:18:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:18:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:18:19 [DEBUG   ] Finished updating board flags in 2.140 seconds
2019-01-14 16:18:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 16:18:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:19:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 16:19:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 16:19:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:19:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:19:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:19:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:19:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:19:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:19:19 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-14 16:19:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 16:19:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 16:20:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-14 16:20:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:20:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:20:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:20:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:20:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:20:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:20:19 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-01-14 16:20:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-14 16:20:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 16:20:59 [DEBUG   ] Got command RPT from MCS: ref #1167762
2019-01-14 16:20:59 [DEBUG   ] summary = ERROR
2019-01-14 16:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167762  13 58497 58859477 A  ERRORERROR'
2019-01-14 16:20:59 [DEBUG   ] Got command RPT from MCS: ref #1167763
2019-01-14 16:20:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167763  77 58497 58859681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:20:59 [DEBUG   ] Got command RPT from MCS: ref #1167764
2019-01-14 16:20:59 [DEBUG   ] summary = ERROR
2019-01-14 16:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167764  13 58497 58859875 A  ERRORERROR'
2019-01-14 16:21:00 [DEBUG   ] Got command RPT from MCS: ref #1167765
2019-01-14 16:21:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167765  77 58497 58860077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:21:00 [DEBUG   ] Got command RPT from MCS: ref #1167766
2019-01-14 16:21:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167766  12 58497 58860281 A  ERRORB™™š'
2019-01-14 16:21:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 16:21:04 [DEBUG   ] Got command RPT from MCS: ref #1167767
2019-01-14 16:21:04 [DEBUG   ] summary = ERROR
2019-01-14 16:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167767  13 58497 58864737 A  ERRORERROR'
2019-01-14 16:21:04 [DEBUG   ] Got command RPT from MCS: ref #1167768
2019-01-14 16:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167768  77 58497 58864738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:21:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 16:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:21:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:21:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:21:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:21:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:21:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:21:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:21:19 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-14 16:21:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 16:21:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 16:22:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:22:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:22:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:22:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:22:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:22:19 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-01-14 16:22:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 16:22:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:23:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 16:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:23:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:23:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:23:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:23:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:23:19 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-14 16:23:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 16:23:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:24:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 16:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:24:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:24:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:24:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:24:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:24:19 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-14 16:24:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 16:24:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 16:25:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 16:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:25:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:25:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:25:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:25:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:25:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:25:19 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-14 16:25:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 16:25:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 16:25:59 [DEBUG   ] Got command RPT from MCS: ref #1167790
2019-01-14 16:25:59 [DEBUG   ] summary = ERROR
2019-01-14 16:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167790  13 58497 59159557 A  ERRORERROR'
2019-01-14 16:25:59 [DEBUG   ] Got command RPT from MCS: ref #1167791
2019-01-14 16:25:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167791  77 58497 59159761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:25:59 [DEBUG   ] Got command RPT from MCS: ref #1167792
2019-01-14 16:25:59 [DEBUG   ] summary = ERROR
2019-01-14 16:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167792  13 58497 59159965 A  ERRORERROR'
2019-01-14 16:26:00 [DEBUG   ] Got command RPT from MCS: ref #1167794
2019-01-14 16:26:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167794  77 58497 59160157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:26:00 [DEBUG   ] Got command RPT from MCS: ref #1167796
2019-01-14 16:26:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167796  12 58497 59160361 A  ERRORB˜™š'
2019-01-14 16:26:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 16:26:04 [DEBUG   ] Got command RPT from MCS: ref #1167800
2019-01-14 16:26:04 [DEBUG   ] summary = ERROR
2019-01-14 16:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167800  13 58497 59164745 A  ERRORERROR'
2019-01-14 16:26:04 [DEBUG   ] Got command RPT from MCS: ref #1167801
2019-01-14 16:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167801  77 58497 59164746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:26:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 16:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:26:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:26:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:26:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:26:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:26:19 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-14 16:26:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:26:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:27:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:27:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:27:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:27:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:27:19 [WARNING ] (13, 1, 'bot')
2019-01-14 16:27:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:27:19 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-01-14 16:27:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:27:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 16:28:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 16:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:28:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:28:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:28:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:28:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:28:20 [DEBUG   ] Finished updating board flags in 2.061 seconds
2019-01-14 16:28:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:28:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:29:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 16:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:29:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:29:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:29:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:29:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:29:20 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-14 16:29:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 16:29:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 16:30:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:30:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:30:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:30:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:30:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:30:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:30:20 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-14 16:30:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:30:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:30:59 [DEBUG   ] Got command RPT from MCS: ref #1167825
2019-01-14 16:30:59 [DEBUG   ] summary = ERROR
2019-01-14 16:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167825  13 58497 59459649 A  ERRORERROR'
2019-01-14 16:30:59 [DEBUG   ] Got command RPT from MCS: ref #1167826
2019-01-14 16:30:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167826  77 58497 59459841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:31:00 [DEBUG   ] Got command RPT from MCS: ref #1167827
2019-01-14 16:31:00 [DEBUG   ] summary = ERROR
2019-01-14 16:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167827  13 58497 59460045 A  ERRORERROR'
2019-01-14 16:31:00 [DEBUG   ] Got command RPT from MCS: ref #1167828
2019-01-14 16:31:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167828  77 58497 59460249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:31:00 [DEBUG   ] Got command RPT from MCS: ref #1167829
2019-01-14 16:31:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167829  12 58497 59460453 A  ERRORB˜™š'
2019-01-14 16:31:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:31:04 [DEBUG   ] Got command RPT from MCS: ref #1167830
2019-01-14 16:31:04 [DEBUG   ] summary = ERROR
2019-01-14 16:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167830  13 58497 59464749 A  ERRORERROR'
2019-01-14 16:31:04 [DEBUG   ] Got command RPT from MCS: ref #1167831
2019-01-14 16:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167831  77 58497 59464750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:31:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:31:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:31:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:31:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:31:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:31:20 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-14 16:31:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 16:31:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 16:32:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 16:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:32:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:32:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:32:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:32:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:32:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:32:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:32:20 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-14 16:32:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:32:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 16:33:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:33:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:33:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:33:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:33:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:33:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:33:20 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-14 16:33:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 16:33:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:34:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 16:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:34:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:34:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:34:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:34:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:34:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:34:20 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-14 16:34:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 16:34:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 16:35:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 16:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:35:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:35:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:35:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:35:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:35:20 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-14 16:35:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 16:35:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:35:59 [DEBUG   ] Got command RPT from MCS: ref #1167857
2019-01-14 16:35:59 [DEBUG   ] summary = ERROR
2019-01-14 16:35:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167857  13 58497 59759725 A  ERRORERROR'
2019-01-14 16:35:59 [DEBUG   ] Got command RPT from MCS: ref #1167858
2019-01-14 16:35:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:35:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167858  77 58497 59759929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:36:00 [DEBUG   ] Got command RPT from MCS: ref #1167859
2019-01-14 16:36:00 [DEBUG   ] summary = ERROR
2019-01-14 16:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167859  13 58497 59760133 A  ERRORERROR'
2019-01-14 16:36:00 [DEBUG   ] Got command RPT from MCS: ref #1167861
2019-01-14 16:36:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167861  77 58497 59760337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:36:00 [DEBUG   ] Got command RPT from MCS: ref #1167863
2019-01-14 16:36:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167863  12 58497 59760529 A  ERRORB˜™š'
2019-01-14 16:36:04 [DEBUG   ] Got command RPT from MCS: ref #1167867
2019-01-14 16:36:04 [DEBUG   ] summary = ERROR
2019-01-14 16:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167867  13 58497 59764741 A  ERRORERROR'
2019-01-14 16:36:04 [DEBUG   ] Got command RPT from MCS: ref #1167868
2019-01-14 16:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167868  77 58497 59764742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:36:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:36:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:36:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:36:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:36:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:36:20 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-14 16:36:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 16:36:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 16:37:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:37:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:37:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:37:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:37:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:37:20 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-14 16:37:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:37:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 16:38:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:38:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:38:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:38:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:38:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:38:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:38:20 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-14 16:38:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 16:38:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:39:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 16:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:39:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:39:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:39:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:39:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:39:20 [WARNING ] (13, 1, 'bot')
2019-01-14 16:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:39:20 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-14 16:39:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 16:39:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 16:40:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:40:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:40:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:40:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:40:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:40:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:40:21 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-01-14 16:40:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:40:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:40:59 [DEBUG   ] Got command RPT from MCS: ref #1167888
2019-01-14 16:40:59 [DEBUG   ] summary = ERROR
2019-01-14 16:40:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167888  13 58497 60059821 A  ERRORERROR'
2019-01-14 16:41:00 [DEBUG   ] Got command RPT from MCS: ref #1167889
2019-01-14 16:41:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:41:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167889  77 58497 60060025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:41:00 [DEBUG   ] Got command RPT from MCS: ref #1167890
2019-01-14 16:41:00 [DEBUG   ] summary = ERROR
2019-01-14 16:41:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167890  13 58497 60060217 A  ERRORERROR'
2019-01-14 16:41:00 [DEBUG   ] Got command RPT from MCS: ref #1167891
2019-01-14 16:41:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:41:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167891  77 58497 60060421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:41:00 [DEBUG   ] Got command RPT from MCS: ref #1167892
2019-01-14 16:41:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:41:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167892  12 58497 60060635 A  ERRORB˜™š'
2019-01-14 16:41:04 [DEBUG   ] Got command RPT from MCS: ref #1167893
2019-01-14 16:41:04 [DEBUG   ] summary = ERROR
2019-01-14 16:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167893  13 58497 60064749 A  ERRORERROR'
2019-01-14 16:41:04 [DEBUG   ] Got command RPT from MCS: ref #1167894
2019-01-14 16:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167894  77 58497 60064750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:41:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 16:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 16:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:41:21 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:41:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:41:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:41:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:41:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:41:21 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-14 16:41:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 16:41:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 16:42:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:42:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 16:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:42:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:42:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:42:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:42:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:42:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:42:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:42:21 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-14 16:42:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 16:42:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 16:43:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 16:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:43:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 16:43:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:43:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:43:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:43:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:43:21 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-14 16:43:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:43:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:44:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 16:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:44:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:44:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:44:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:44:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:44:21 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-14 16:44:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 16:44:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 16:45:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 16:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:45:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:45:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:45:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:45:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:45:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:45:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:45:21 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-14 16:45:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 16:45:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 16:45:59 [DEBUG   ] Got command RPT from MCS: ref #1167920
2019-01-14 16:45:59 [DEBUG   ] summary = ERROR
2019-01-14 16:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167920  13 58497 60359901 A  ERRORERROR'
2019-01-14 16:46:00 [DEBUG   ] Got command RPT from MCS: ref #1167921
2019-01-14 16:46:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167921  77 58497 60360105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:46:00 [DEBUG   ] Got command RPT from MCS: ref #1167922
2019-01-14 16:46:00 [DEBUG   ] summary = ERROR
2019-01-14 16:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167922  13 58497 60360309 A  ERRORERROR'
2019-01-14 16:46:00 [DEBUG   ] Got command RPT from MCS: ref #1167924
2019-01-14 16:46:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167924  77 58497 60360513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:46:00 [DEBUG   ] Got command RPT from MCS: ref #1167925
2019-01-14 16:46:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167925  12 58497 60360705 A  ERRORB™™š'
2019-01-14 16:46:04 [DEBUG   ] Got command RPT from MCS: ref #1167930
2019-01-14 16:46:04 [DEBUG   ] summary = ERROR
2019-01-14 16:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167930  13 58497 60364749 A  ERRORERROR'
2019-01-14 16:46:04 [DEBUG   ] Got command RPT from MCS: ref #1167931
2019-01-14 16:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167931  77 58497 60364750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:46:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:46:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:46:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:46:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:46:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:46:21 [DEBUG   ] Finished updating board flags in 1.575 seconds
2019-01-14 16:46:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:46:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 16:47:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:47:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 16:47:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:47:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:47:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:47:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:47:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:47:21 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-14 16:47:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 16:47:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 16:48:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:48:21 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:48:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:48:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:48:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:48:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:48:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:48:21 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-14 16:48:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 16:48:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 16:49:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 16:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:49:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:49:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:49:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:49:21 [WARNING ] (13, 1, 'bot')
2019-01-14 16:49:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:49:21 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-14 16:49:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:49:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 16:50:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 16:50:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:50:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:50:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:50:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:50:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:50:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:50:22 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-01-14 16:50:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 16:50:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 16:50:59 [DEBUG   ] Got command RPT from MCS: ref #1167955
2019-01-14 16:50:59 [DEBUG   ] summary = ERROR
2019-01-14 16:50:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167955  13 58497 60659993 A  ERRORERROR'
2019-01-14 16:51:00 [DEBUG   ] Got command RPT from MCS: ref #1167956
2019-01-14 16:51:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:51:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167956  77 58497 60660197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:51:00 [DEBUG   ] Got command RPT from MCS: ref #1167957
2019-01-14 16:51:00 [DEBUG   ] summary = ERROR
2019-01-14 16:51:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167957  13 58497 60660389 A  ERRORERROR'
2019-01-14 16:51:00 [DEBUG   ] Got command RPT from MCS: ref #1167958
2019-01-14 16:51:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:51:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167958  77 58497 60660593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:51:00 [DEBUG   ] Got command RPT from MCS: ref #1167959
2019-01-14 16:51:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:51:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167959  12 58497 60660797 A  ERRORB˜™š'
2019-01-14 16:51:04 [DEBUG   ] Got command RPT from MCS: ref #1167960
2019-01-14 16:51:04 [DEBUG   ] summary = ERROR
2019-01-14 16:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167960  13 58497 60664745 A  ERRORERROR'
2019-01-14 16:51:04 [DEBUG   ] Got command RPT from MCS: ref #1167961
2019-01-14 16:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167961  77 58497 60664746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:51:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:51:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:51:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:51:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:51:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:51:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:51:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:51:22 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-01-14 16:51:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:51:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:52:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:52:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:52:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:52:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:52:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:52:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:52:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:52:22 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-14 16:52:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 16:52:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 16:53:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 16:53:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:53:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:53:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:53:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:53:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:53:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:53:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:53:22 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-14 16:53:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:53:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 16:54:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:54:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:54:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:54:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:54:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:54:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:54:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:54:22 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-14 16:54:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:54:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 16:55:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 16:55:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:55:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:55:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:55:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:55:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:55:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:55:22 [DEBUG   ] Finished updating board flags in 1.869 seconds
2019-01-14 16:55:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 16:55:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 16:56:00 [DEBUG   ] Got command RPT from MCS: ref #1167983
2019-01-14 16:56:00 [DEBUG   ] summary = ERROR
2019-01-14 16:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167983  13 58497 60960069 A  ERRORERROR'
2019-01-14 16:56:00 [DEBUG   ] Got command RPT from MCS: ref #1167984
2019-01-14 16:56:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167984  77 58497 60960273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:56:00 [DEBUG   ] Got command RPT from MCS: ref #1167985
2019-01-14 16:56:00 [DEBUG   ] summary = ERROR
2019-01-14 16:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167985  13 58497 60960477 A  ERRORERROR'
2019-01-14 16:56:00 [DEBUG   ] Got command RPT from MCS: ref #1167987
2019-01-14 16:56:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167987  77 58497 60960681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:56:00 [DEBUG   ] Got command RPT from MCS: ref #1167989
2019-01-14 16:56:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 16:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167989  12 58497 60960873 A  ERRORB™™š'
2019-01-14 16:56:04 [DEBUG   ] Got command RPT from MCS: ref #1167993
2019-01-14 16:56:04 [DEBUG   ] summary = ERROR
2019-01-14 16:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167993  13 58497 60964749 A  ERRORERROR'
2019-01-14 16:56:04 [DEBUG   ] Got command RPT from MCS: ref #1167994
2019-01-14 16:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 16:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1167994  77 58497 60964750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 16:56:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 16:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:56:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:56:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:56:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:56:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:56:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:56:22 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-14 16:56:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 16:56:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 16:57:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 16:57:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:57:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 16:57:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:57:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:57:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:57:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:57:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:57:22 [DEBUG   ] Finished updating board flags in 1.721 seconds
2019-01-14 16:57:29 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2019-01-14 16:57:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 16:58:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 16:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:58:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 16:58:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:58:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:58:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:58:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:58:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:58:22 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-14 16:58:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 16:58:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 16:59:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 16:59:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:59:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:59:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:59:22 [WARNING ] (13, 1, 'bot')
2019-01-14 16:59:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 16:59:22 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-14 16:59:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 16:59:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:00:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 17:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:00:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 17:00:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 17:00:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:00:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:00:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:00:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:00:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:00:22 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-14 17:00:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 17:00:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 17:01:00 [DEBUG   ] Got command RPT from MCS: ref #1168018
2019-01-14 17:01:00 [DEBUG   ] summary = ERROR
2019-01-14 17:01:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168018  13 58497 61260161 A  ERRORERROR'
2019-01-14 17:01:00 [DEBUG   ] Got command RPT from MCS: ref #1168019
2019-01-14 17:01:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:01:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168019  77 58497 61260365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:01:00 [DEBUG   ] Got command RPT from MCS: ref #1168020
2019-01-14 17:01:00 [DEBUG   ] summary = ERROR
2019-01-14 17:01:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168020  13 58497 61260557 A  ERRORERROR'
2019-01-14 17:01:00 [DEBUG   ] Got command RPT from MCS: ref #1168021
2019-01-14 17:01:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:01:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168021  77 58497 61260761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:01:00 [DEBUG   ] Got command RPT from MCS: ref #1168022
2019-01-14 17:01:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:01:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168022  12 58497 61260965 A  ERRORB™™š'
2019-01-14 17:01:04 [DEBUG   ] Got command RPT from MCS: ref #1168023
2019-01-14 17:01:04 [DEBUG   ] summary = ERROR
2019-01-14 17:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168023  13 58497 61264757 A  ERRORERROR'
2019-01-14 17:01:04 [DEBUG   ] Got command RPT from MCS: ref #1168024
2019-01-14 17:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168024  77 58497 61264758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:01:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 17:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:01:22 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:01:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:01:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:01:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:01:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:01:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:01:22 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-14 17:01:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 17:01:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:02:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 17:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:02:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:02:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:02:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:02:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:02:22 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-14 17:02:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 17:02:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 17:03:11 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 17:03:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:03:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:03:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:03:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:03:22 [WARNING ] (13, 1, 'bot')
2019-01-14 17:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:03:22 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-14 17:03:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 17:03:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 17:04:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 17:04:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:04:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:04:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:04:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:04:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:04:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:04:23 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-01-14 17:04:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 17:04:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:05:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 17:05:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:05:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:05:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:05:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:05:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:05:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:05:23 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-14 17:05:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 17:05:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 17:06:00 [DEBUG   ] Got command RPT from MCS: ref #1168050
2019-01-14 17:06:00 [DEBUG   ] summary = ERROR
2019-01-14 17:06:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168050  13 58497 61560241 A  ERRORERROR'
2019-01-14 17:06:00 [DEBUG   ] Got command RPT from MCS: ref #1168051
2019-01-14 17:06:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:06:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168051  77 58497 61560445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:06:00 [DEBUG   ] Got command RPT from MCS: ref #1168052
2019-01-14 17:06:00 [DEBUG   ] summary = ERROR
2019-01-14 17:06:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168052  13 58497 61560649 A  ERRORERROR'
2019-01-14 17:06:00 [DEBUG   ] Got command RPT from MCS: ref #1168054
2019-01-14 17:06:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:06:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168054  77 58497 61560841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:06:01 [DEBUG   ] Got command RPT from MCS: ref #1168056
2019-01-14 17:06:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168056  12 58497 61561045 A  ERRORB™™š'
2019-01-14 17:06:04 [DEBUG   ] Got command RPT from MCS: ref #1168060
2019-01-14 17:06:04 [DEBUG   ] summary = ERROR
2019-01-14 17:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168060  13 58497 61564753 A  ERRORERROR'
2019-01-14 17:06:04 [DEBUG   ] Got command RPT from MCS: ref #1168061
2019-01-14 17:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168061  77 58497 61564754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:06:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 17:06:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:06:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:06:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:06:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:06:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:06:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:06:23 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-01-14 17:06:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:06:51 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 17:07:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 17:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:07:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 17:07:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:07:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:07:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:07:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:07:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:07:23 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-14 17:07:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:07:51 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 17:08:11 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-14 17:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:08:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 17:08:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 17:08:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:08:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:08:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:08:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:08:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:08:23 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-14 17:08:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 17:08:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 17:09:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 17:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:09:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:09:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:09:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:09:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:09:23 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-14 17:09:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 17:09:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:10:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 17:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:10:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:10:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:10:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:10:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:10:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:10:23 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-14 17:10:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 17:10:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 17:11:00 [DEBUG   ] Got command RPT from MCS: ref #1168081
2019-01-14 17:11:00 [DEBUG   ] summary = ERROR
2019-01-14 17:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168081  13 58497 61860329 A  ERRORERROR'
2019-01-14 17:11:00 [DEBUG   ] Got command RPT from MCS: ref #1168082
2019-01-14 17:11:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168082  77 58497 61860533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:11:00 [DEBUG   ] Got command RPT from MCS: ref #1168083
2019-01-14 17:11:00 [DEBUG   ] summary = ERROR
2019-01-14 17:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168083  13 58497 61860737 A  ERRORERROR'
2019-01-14 17:11:00 [DEBUG   ] Got command RPT from MCS: ref #1168084
2019-01-14 17:11:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168084  77 58497 61860929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:11:01 [DEBUG   ] Got command RPT from MCS: ref #1168085
2019-01-14 17:11:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:11:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168085  12 58497 61861133 A  ERRORB™™š'
2019-01-14 17:11:04 [DEBUG   ] Got command RPT from MCS: ref #1168086
2019-01-14 17:11:04 [DEBUG   ] summary = ERROR
2019-01-14 17:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168086  13 58497 61864757 A  ERRORERROR'
2019-01-14 17:11:04 [DEBUG   ] Got command RPT from MCS: ref #1168087
2019-01-14 17:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168087  77 58497 61864758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:11:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:11:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 17:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:11:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:11:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:11:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:11:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:11:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:11:23 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-14 17:11:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:11:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:12:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 17:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:12:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:12:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:12:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:12:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:12:23 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-14 17:12:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:12:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:13:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:13:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:13:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:13:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:13:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:13:23 [DEBUG   ] Finished updating board flags in 1.766 seconds
2019-01-14 17:13:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 17:13:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 17:14:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 17:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:14:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:14:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:14:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:14:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:14:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:14:23 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-14 17:14:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 17:14:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:15:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 17:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:15:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:15:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:15:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:15:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:15:23 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-14 17:15:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 17:15:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 17:16:00 [DEBUG   ] Got command RPT from MCS: ref #1168113
2019-01-14 17:16:00 [DEBUG   ] summary = ERROR
2019-01-14 17:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168113  13 58497 62160413 A  ERRORERROR'
2019-01-14 17:16:00 [DEBUG   ] Got command RPT from MCS: ref #1168114
2019-01-14 17:16:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168114  77 58497 62160617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:16:00 [DEBUG   ] Got command RPT from MCS: ref #1168115
2019-01-14 17:16:00 [DEBUG   ] summary = ERROR
2019-01-14 17:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168115  13 58497 62160821 A  ERRORERROR'
2019-01-14 17:16:01 [DEBUG   ] Got command RPT from MCS: ref #1168117
2019-01-14 17:16:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168117  77 58497 62161013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:16:01 [DEBUG   ] Got command RPT from MCS: ref #1168119
2019-01-14 17:16:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168119  12 58497 62161217 A  ERRORB˜™š'
2019-01-14 17:16:04 [DEBUG   ] Got command RPT from MCS: ref #1168123
2019-01-14 17:16:04 [DEBUG   ] summary = ERROR
2019-01-14 17:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168123  13 58497 62164757 A  ERRORERROR'
2019-01-14 17:16:04 [DEBUG   ] Got command RPT from MCS: ref #1168124
2019-01-14 17:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168124  77 58497 62164758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:16:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:16:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 17:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:16:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:16:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:16:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:16:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:16:23 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-14 17:16:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:16:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 17:17:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:17:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:17:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:17:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:17:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:17:23 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-14 17:17:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:17:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:18:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:18:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:18:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:18:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:18:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:18:23 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-14 17:18:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 17:18:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 17:19:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 17:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:19:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:19:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:19:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:19:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:19:23 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-14 17:19:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 17:19:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 17:20:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:20:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:20:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:20:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:20:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:20:23 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-14 17:20:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:20:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 17:21:00 [DEBUG   ] Got command RPT from MCS: ref #1168148
2019-01-14 17:21:00 [DEBUG   ] summary = ERROR
2019-01-14 17:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168148  13 58497 62460501 A  ERRORERROR'
2019-01-14 17:21:00 [DEBUG   ] Got command RPT from MCS: ref #1168149
2019-01-14 17:21:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168149  77 58497 62460705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:21:00 [DEBUG   ] Got command RPT from MCS: ref #1168150
2019-01-14 17:21:00 [DEBUG   ] summary = ERROR
2019-01-14 17:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168150  13 58497 62460909 A  ERRORERROR'
2019-01-14 17:21:01 [DEBUG   ] Got command RPT from MCS: ref #1168151
2019-01-14 17:21:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168151  77 58497 62461101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:21:01 [DEBUG   ] Got command RPT from MCS: ref #1168152
2019-01-14 17:21:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168152  12 58497 62461305 A  ERRORB—™š'
2019-01-14 17:21:04 [DEBUG   ] Got command RPT from MCS: ref #1168153
2019-01-14 17:21:04 [DEBUG   ] summary = ERROR
2019-01-14 17:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168153  13 58497 62464761 A  ERRORERROR'
2019-01-14 17:21:04 [DEBUG   ] Got command RPT from MCS: ref #1168154
2019-01-14 17:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168154  77 58497 62464762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:21:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:21:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:21:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:21:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:21:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:21:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:21:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:21:23 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-14 17:21:34 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-14 17:21:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 17:22:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 17:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:22:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:22:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:22:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:22:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:22:23 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-14 17:22:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 17:22:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 17:23:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:23:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:23:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:23:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:23:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:23:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:23:23 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-14 17:23:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 17:23:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 17:24:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 17:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:24:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:24:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:24:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:24:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:24:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:24:23 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-14 17:24:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:24:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:25:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:25:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:25:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:25:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:25:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:25:23 [WARNING ] (13, 1, 'bot')
2019-01-14 17:25:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:25:23 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-14 17:25:35 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-14 17:25:56 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 17:26:00 [DEBUG   ] Got command RPT from MCS: ref #1168176
2019-01-14 17:26:00 [DEBUG   ] summary = ERROR
2019-01-14 17:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168176  13 58497 62760585 A  ERRORERROR'
2019-01-14 17:26:00 [DEBUG   ] Got command RPT from MCS: ref #1168177
2019-01-14 17:26:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168177  77 58497 62760789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:26:00 [DEBUG   ] Got command RPT from MCS: ref #1168178
2019-01-14 17:26:00 [DEBUG   ] summary = ERROR
2019-01-14 17:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168178  13 58497 62760993 A  ERRORERROR'
2019-01-14 17:26:01 [DEBUG   ] Got command RPT from MCS: ref #1168180
2019-01-14 17:26:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168180  77 58497 62761185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:26:01 [DEBUG   ] Got command RPT from MCS: ref #1168181
2019-01-14 17:26:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168181  12 58497 62761389 A  ERRORB™™š'
2019-01-14 17:26:04 [DEBUG   ] Got command RPT from MCS: ref #1168186
2019-01-14 17:26:04 [DEBUG   ] summary = ERROR
2019-01-14 17:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168186  13 58497 62764761 A  ERRORERROR'
2019-01-14 17:26:04 [DEBUG   ] Got command RPT from MCS: ref #1168187
2019-01-14 17:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168187  77 58497 62764762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:26:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 17:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:26:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:26:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:26:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:26:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:26:24 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-01-14 17:26:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 17:26:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:27:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 17:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:27:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:27:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:27:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:27:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:27:24 [DEBUG   ] Finished updating board flags in 2.163 seconds
2019-01-14 17:27:36 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-14 17:27:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 17:28:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:28:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:28:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:28:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:28:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:28:24 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-01-14 17:28:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:28:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:29:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 17:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:29:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:29:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:29:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:29:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:29:24 [DEBUG   ] Finished updating board flags in 1.975 seconds
2019-01-14 17:29:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:29:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:30:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 17:30:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:30:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:30:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:30:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:30:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:30:24 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-14 17:30:36 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-14 17:30:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 17:31:00 [DEBUG   ] Got command RPT from MCS: ref #1168211
2019-01-14 17:31:00 [DEBUG   ] summary = ERROR
2019-01-14 17:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168211  13 58497 63060677 A  ERRORERROR'
2019-01-14 17:31:00 [DEBUG   ] Got command RPT from MCS: ref #1168212
2019-01-14 17:31:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168212  77 58497 63060881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:31:01 [DEBUG   ] Got command RPT from MCS: ref #1168213
2019-01-14 17:31:01 [DEBUG   ] summary = ERROR
2019-01-14 17:31:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168213  13 58497 63061073 A  ERRORERROR'
2019-01-14 17:31:01 [DEBUG   ] Got command RPT from MCS: ref #1168214
2019-01-14 17:31:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:31:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168214  77 58497 63061277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:31:01 [DEBUG   ] Got command RPT from MCS: ref #1168215
2019-01-14 17:31:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:31:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168215  12 58497 63061481 A  ERRORB˜™š'
2019-01-14 17:31:04 [DEBUG   ] Got command RPT from MCS: ref #1168216
2019-01-14 17:31:04 [DEBUG   ] summary = ERROR
2019-01-14 17:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168216  13 58497 63064757 A  ERRORERROR'
2019-01-14 17:31:04 [DEBUG   ] Got command RPT from MCS: ref #1168217
2019-01-14 17:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168217  77 58497 63064758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:31:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 17:31:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:31:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:31:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:31:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:31:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:31:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:31:24 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-14 17:31:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 17:31:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:32:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 17:32:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:32:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:32:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:32:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:32:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:32:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:32:24 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-14 17:32:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 17:32:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 17:33:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:33:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:33:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:33:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:33:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:33:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:33:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:33:24 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-14 17:33:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:33:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:34:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 17:34:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:34:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:34:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:34:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:34:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:34:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:34:24 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-14 17:34:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 17:34:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 17:35:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 17:35:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 17:35:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:35:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:35:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:35:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:35:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:35:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:35:24 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-14 17:35:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 17:35:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 17:36:00 [DEBUG   ] Got command RPT from MCS: ref #1168243
2019-01-14 17:36:00 [DEBUG   ] summary = ERROR
2019-01-14 17:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168243  13 58497 63360757 A  ERRORERROR'
2019-01-14 17:36:00 [DEBUG   ] Got command RPT from MCS: ref #1168244
2019-01-14 17:36:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168244  77 58497 63360961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:36:01 [DEBUG   ] Got command RPT from MCS: ref #1168245
2019-01-14 17:36:01 [DEBUG   ] summary = ERROR
2019-01-14 17:36:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168245  13 58497 63361165 A  ERRORERROR'
2019-01-14 17:36:01 [DEBUG   ] Got command RPT from MCS: ref #1168247
2019-01-14 17:36:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:36:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168247  77 58497 63361357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:36:01 [DEBUG   ] Got command RPT from MCS: ref #1168248
2019-01-14 17:36:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:36:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168248  12 58497 63361561 A  ERRORB—™š'
2019-01-14 17:36:04 [DEBUG   ] Got command RPT from MCS: ref #1168253
2019-01-14 17:36:04 [DEBUG   ] summary = ERROR
2019-01-14 17:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168253  13 58497 63364753 A  ERRORERROR'
2019-01-14 17:36:04 [DEBUG   ] Got command RPT from MCS: ref #1168254
2019-01-14 17:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168254  77 58497 63364754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:36:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 17:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:36:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:36:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:36:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:36:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:36:24 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-01-14 17:36:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 17:36:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 17:37:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 17:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:37:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:37:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:37:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:37:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:37:24 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-01-14 17:37:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 17:37:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 17:38:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:38:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:38:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:38:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:38:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:38:24 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-14 17:38:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:38:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:39:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 17:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:39:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:39:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:39:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:39:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:39:24 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-14 17:39:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:39:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:40:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:40:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:40:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:40:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:40:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:40:24 [WARNING ] (13, 1, 'bot')
2019-01-14 17:40:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:40:24 [DEBUG   ] Finished updating board flags in 1.460 seconds
2019-01-14 17:40:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:40:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:41:00 [DEBUG   ] Got command RPT from MCS: ref #1168274
2019-01-14 17:41:00 [DEBUG   ] summary = ERROR
2019-01-14 17:41:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168274  13 58497 63660857 A  ERRORERROR'
2019-01-14 17:41:01 [DEBUG   ] Got command RPT from MCS: ref #1168275
2019-01-14 17:41:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168275  77 58497 63661061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:41:01 [DEBUG   ] Got command RPT from MCS: ref #1168276
2019-01-14 17:41:01 [DEBUG   ] summary = ERROR
2019-01-14 17:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168276  13 58497 63661253 A  ERRORERROR'
2019-01-14 17:41:01 [DEBUG   ] Got command RPT from MCS: ref #1168277
2019-01-14 17:41:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168277  77 58497 63661457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:41:01 [DEBUG   ] Got command RPT from MCS: ref #1168278
2019-01-14 17:41:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168278  12 58497 63661661 A  ERRORB˜™š'
2019-01-14 17:41:04 [DEBUG   ] Got command RPT from MCS: ref #1168279
2019-01-14 17:41:04 [DEBUG   ] summary = ERROR
2019-01-14 17:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168279  13 58497 63664757 A  ERRORERROR'
2019-01-14 17:41:04 [DEBUG   ] Got command RPT from MCS: ref #1168280
2019-01-14 17:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168280  77 58497 63664758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:41:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:41:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:41:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:41:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:41:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:41:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:41:25 [DEBUG   ] Finished updating board flags in 2.261 seconds
2019-01-14 17:41:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:41:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:42:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 17:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:42:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:42:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:42:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:42:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:42:25 [DEBUG   ] Finished updating board flags in 2.116 seconds
2019-01-14 17:42:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 17:42:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 17:43:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 17:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:43:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:43:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:43:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:43:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:43:25 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-14 17:43:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 17:43:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 17:44:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:44:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:44:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:44:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:44:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:44:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:44:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:44:25 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-14 17:44:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 17:44:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 17:45:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 17:45:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 17:45:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:45:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:45:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:45:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:45:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:45:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:45:25 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-14 17:45:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 17:45:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:46:00 [DEBUG   ] Got command RPT from MCS: ref #1168306
2019-01-14 17:46:00 [DEBUG   ] summary = ERROR
2019-01-14 17:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168306  13 58497 63960941 A  ERRORERROR'
2019-01-14 17:46:01 [DEBUG   ] Got command RPT from MCS: ref #1168307
2019-01-14 17:46:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168307  77 58497 63961145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:46:01 [DEBUG   ] Got command RPT from MCS: ref #1168308
2019-01-14 17:46:01 [DEBUG   ] summary = ERROR
2019-01-14 17:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168308  13 58497 63961349 A  ERRORERROR'
2019-01-14 17:46:01 [DEBUG   ] Got command RPT from MCS: ref #1168310
2019-01-14 17:46:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168310  77 58497 63961541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:46:01 [DEBUG   ] Got command RPT from MCS: ref #1168312
2019-01-14 17:46:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168312  12 58497 63961745 A  ERRORB˜™š'
2019-01-14 17:46:04 [DEBUG   ] Got command RPT from MCS: ref #1168316
2019-01-14 17:46:04 [DEBUG   ] summary = ERROR
2019-01-14 17:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168316  13 58497 63964757 A  ERRORERROR'
2019-01-14 17:46:04 [DEBUG   ] Got command RPT from MCS: ref #1168317
2019-01-14 17:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168317  77 58497 63964758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:46:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:46:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:46:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:46:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:46:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:46:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:46:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:46:25 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-14 17:46:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:46:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:47:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:47:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:47:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:47:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:47:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:47:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:47:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:47:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:47:25 [DEBUG   ] Finished updating board flags in 1.641 seconds
2019-01-14 17:47:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:47:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 17:48:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:48:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:48:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:48:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:48:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:48:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:48:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:48:25 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-14 17:48:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:48:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:49:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:49:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:49:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:49:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:49:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:49:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:49:25 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-14 17:49:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:49:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:50:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:50:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:50:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:50:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:50:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:50:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:50:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:50:25 [DEBUG   ] Finished updating board flags in 1.476 seconds
2019-01-14 17:50:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:50:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:51:01 [DEBUG   ] Got command RPT from MCS: ref #1168341
2019-01-14 17:51:01 [DEBUG   ] summary = ERROR
2019-01-14 17:51:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168341  13 58497 64261029 A  ERRORERROR'
2019-01-14 17:51:01 [DEBUG   ] Got command RPT from MCS: ref #1168342
2019-01-14 17:51:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:51:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168342  77 58497 64261233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:51:01 [DEBUG   ] Got command RPT from MCS: ref #1168343
2019-01-14 17:51:01 [DEBUG   ] summary = ERROR
2019-01-14 17:51:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168343  13 58497 64261425 A  ERRORERROR'
2019-01-14 17:51:01 [DEBUG   ] Got command RPT from MCS: ref #1168344
2019-01-14 17:51:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:51:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168344  77 58497 64261629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:51:01 [DEBUG   ] Got command RPT from MCS: ref #1168345
2019-01-14 17:51:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:51:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168345  12 58497 64261833 A  ERRORB—™š'
2019-01-14 17:51:04 [DEBUG   ] Got command RPT from MCS: ref #1168346
2019-01-14 17:51:04 [DEBUG   ] summary = ERROR
2019-01-14 17:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168346  13 58497 64264761 A  ERRORERROR'
2019-01-14 17:51:04 [DEBUG   ] Got command RPT from MCS: ref #1168347
2019-01-14 17:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168347  77 58497 64264762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:51:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 17:51:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 17:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:51:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:51:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:51:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:51:25 [WARNING ] (13, 1, 'bot')
2019-01-14 17:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:51:25 [DEBUG   ] Finished updating board flags in 1.567 seconds
2019-01-14 17:51:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:51:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:52:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 17:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:52:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:52:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:52:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:52:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:52:26 [DEBUG   ] Finished updating board flags in 2.256 seconds
2019-01-14 17:52:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 17:52:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 17:53:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 17:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:53:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 17:53:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:53:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:53:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:53:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:53:26 [DEBUG   ] Finished updating board flags in 2.091 seconds
2019-01-14 17:53:40 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-14 17:54:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 17:54:20 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2019-01-14 17:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:54:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:54:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:54:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:54:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:54:26 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-01-14 17:54:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:55:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 17:55:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 17:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:55:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:55:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:55:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:55:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:55:26 [DEBUG   ] Finished updating board flags in 1.964 seconds
2019-01-14 17:55:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 17:56:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:56:01 [DEBUG   ] Got command RPT from MCS: ref #1168369
2019-01-14 17:56:01 [DEBUG   ] summary = ERROR
2019-01-14 17:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168369  13 58497 64561113 A  ERRORERROR'
2019-01-14 17:56:01 [DEBUG   ] Got command RPT from MCS: ref #1168370
2019-01-14 17:56:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168370  77 58497 64561317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:56:01 [DEBUG   ] Got command RPT from MCS: ref #1168371
2019-01-14 17:56:01 [DEBUG   ] summary = ERROR
2019-01-14 17:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168371  13 58497 64561521 A  ERRORERROR'
2019-01-14 17:56:01 [DEBUG   ] Got command RPT from MCS: ref #1168373
2019-01-14 17:56:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168373  77 58497 64561713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:56:01 [DEBUG   ] Got command RPT from MCS: ref #1168374
2019-01-14 17:56:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 17:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168374  12 58497 64561917 A  ERRORB˜™š'
2019-01-14 17:56:04 [DEBUG   ] Got command RPT from MCS: ref #1168379
2019-01-14 17:56:04 [DEBUG   ] summary = ERROR
2019-01-14 17:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168379  13 58497 64564761 A  ERRORERROR'
2019-01-14 17:56:04 [DEBUG   ] Got command RPT from MCS: ref #1168380
2019-01-14 17:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 17:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168380  77 58497 64564762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 17:56:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 17:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:56:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:56:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:56:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:56:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:56:26 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-14 17:56:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 17:57:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 17:57:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 17:57:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 17:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:57:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 17:57:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 17:57:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:57:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:57:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:57:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:57:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:57:26 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-14 17:57:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:58:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:58:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 17:58:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:58:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:58:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:58:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:58:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:58:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:58:26 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-01-14 17:58:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:59:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 17:59:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 17:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 17:59:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:59:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:59:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:59:26 [WARNING ] (13, 1, 'bot')
2019-01-14 17:59:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 17:59:26 [DEBUG   ] Finished updating board flags in 1.735 seconds
2019-01-14 17:59:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 18:00:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 18:00:20 [DEBUG   ] Finished updating ant stats in 0.471 seconds
2019-01-14 18:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:00:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:00:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:00:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:00:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:00:26 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-14 18:00:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 18:01:01 [DEBUG   ] Got command RPT from MCS: ref #1168404
2019-01-14 18:01:01 [DEBUG   ] summary = ERROR
2019-01-14 18:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168404  13 58497 64861201 A  ERRORERROR'
2019-01-14 18:01:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 18:01:01 [DEBUG   ] Got command RPT from MCS: ref #1168405
2019-01-14 18:01:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168405  77 58497 64861405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:01:01 [DEBUG   ] Got command RPT from MCS: ref #1168406
2019-01-14 18:01:01 [DEBUG   ] summary = ERROR
2019-01-14 18:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168406  13 58497 64861597 A  ERRORERROR'
2019-01-14 18:01:01 [DEBUG   ] Got command RPT from MCS: ref #1168407
2019-01-14 18:01:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168407  77 58497 64861801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:01:02 [DEBUG   ] Got command RPT from MCS: ref #1168408
2019-01-14 18:01:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:01:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168408  12 58497 64862005 A  ERRORB˜™š'
2019-01-14 18:01:04 [DEBUG   ] Got command RPT from MCS: ref #1168409
2019-01-14 18:01:04 [DEBUG   ] summary = ERROR
2019-01-14 18:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168409  13 58497 64864765 A  ERRORERROR'
2019-01-14 18:01:04 [DEBUG   ] Got command RPT from MCS: ref #1168410
2019-01-14 18:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168410  77 58497 64864766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:01:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 18:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:01:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:01:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:01:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:01:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:01:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:01:26 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-14 18:01:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:02:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 18:02:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 18:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:02:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:02:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:02:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:02:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:02:26 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-14 18:02:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 18:03:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:03:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 18:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:03:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:03:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:03:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:03:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:03:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:03:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:03:26 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-14 18:03:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:04:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 18:04:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 18:04:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:04:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:04:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:04:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:04:26 [WARNING ] (13, 1, 'bot')
2019-01-14 18:04:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:04:26 [DEBUG   ] Finished updating board flags in 1.375 seconds
2019-01-14 18:04:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 18:05:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 18:05:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 18:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:05:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:05:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:05:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:05:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:05:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:05:27 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-14 18:05:42 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-14 18:06:01 [DEBUG   ] Got command RPT from MCS: ref #1168436
2019-01-14 18:06:01 [DEBUG   ] summary = ERROR
2019-01-14 18:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168436  13 58497 65161282 A  ERRORERROR'
2019-01-14 18:06:01 [DEBUG   ] Got command RPT from MCS: ref #1168437
2019-01-14 18:06:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168437  77 58497 65161489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:06:01 [DEBUG   ] Got command RPT from MCS: ref #1168438
2019-01-14 18:06:01 [DEBUG   ] summary = ERROR
2019-01-14 18:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168438  13 58497 65161681 A  ERRORERROR'
2019-01-14 18:06:01 [DEBUG   ] Got command RPT from MCS: ref #1168440
2019-01-14 18:06:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168440  77 58497 65161885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:06:02 [DEBUG   ] Got command RPT from MCS: ref #1168441
2019-01-14 18:06:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168441  12 58497 65162089 A  ERRORB—™š'
2019-01-14 18:06:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 18:06:04 [DEBUG   ] Got command RPT from MCS: ref #1168446
2019-01-14 18:06:04 [DEBUG   ] summary = ERROR
2019-01-14 18:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168446  13 58497 65164765 A  ERRORERROR'
2019-01-14 18:06:04 [DEBUG   ] Got command RPT from MCS: ref #1168447
2019-01-14 18:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168447  77 58497 65164766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:06:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:06:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:06:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:06:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:06:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:06:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:06:27 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-01-14 18:06:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:07:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:07:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:07:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:07:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:07:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:07:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:07:27 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-01-14 18:07:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:08:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:08:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:08:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:08:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:08:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:08:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:08:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:08:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:08:27 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-14 18:08:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:09:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:09:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:09:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:09:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:09:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:09:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:09:27 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-01-14 18:09:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:10:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:10:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 18:10:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:10:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:10:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:10:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:10:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:10:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:10:27 [DEBUG   ] Finished updating board flags in 1.726 seconds
2019-01-14 18:10:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:11:01 [DEBUG   ] Got command RPT from MCS: ref #1168467
2019-01-14 18:11:01 [DEBUG   ] summary = ERROR
2019-01-14 18:11:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168467  13 58497 65461378 A  ERRORERROR'
2019-01-14 18:11:01 [DEBUG   ] Got command RPT from MCS: ref #1168468
2019-01-14 18:11:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:11:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168468  77 58497 65461574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:11:01 [DEBUG   ] Got command RPT from MCS: ref #1168469
2019-01-14 18:11:01 [DEBUG   ] summary = ERROR
2019-01-14 18:11:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168469  13 58497 65461777 A  ERRORERROR'
2019-01-14 18:11:01 [DEBUG   ] Got command RPT from MCS: ref #1168470
2019-01-14 18:11:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:11:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168470  77 58497 65461969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:11:02 [DEBUG   ] Got command RPT from MCS: ref #1168471
2019-01-14 18:11:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168471  12 58497 65462173 A  ERRORB˜™š'
2019-01-14 18:11:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 18:11:04 [DEBUG   ] Got command RPT from MCS: ref #1168472
2019-01-14 18:11:04 [DEBUG   ] summary = ERROR
2019-01-14 18:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168472  13 58497 65464765 A  ERRORERROR'
2019-01-14 18:11:04 [DEBUG   ] Got command RPT from MCS: ref #1168473
2019-01-14 18:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168473  77 58497 65464766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:11:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:11:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:11:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:11:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:11:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:11:27 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-14 18:11:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:12:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 18:12:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 18:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:12:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:12:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:12:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:12:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:12:27 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-14 18:12:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 18:13:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 18:13:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 18:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:13:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 18:13:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:13:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:13:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:13:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:13:27 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-14 18:13:42 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-14 18:14:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 18:14:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 18:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:14:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:14:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:14:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:14:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:14:27 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-14 18:14:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 18:15:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:15:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:15:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:15:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:15:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:15:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:15:27 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-14 18:15:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:16:01 [DEBUG   ] Got command RPT from MCS: ref #1168499
2019-01-14 18:16:01 [DEBUG   ] summary = ERROR
2019-01-14 18:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168499  13 58497 65761453 A  ERRORERROR'
2019-01-14 18:16:01 [DEBUG   ] Got command RPT from MCS: ref #1168500
2019-01-14 18:16:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168500  77 58497 65761661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:16:01 [DEBUG   ] Got command RPT from MCS: ref #1168501
2019-01-14 18:16:01 [DEBUG   ] summary = ERROR
2019-01-14 18:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168501  13 58497 65761861 A  ERRORERROR'
2019-01-14 18:16:02 [DEBUG   ] Got command RPT from MCS: ref #1168503
2019-01-14 18:16:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:16:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168503  77 58497 65762065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:16:02 [DEBUG   ] Got command RPT from MCS: ref #1168504
2019-01-14 18:16:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:16:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168504  12 58497 65762257 A  ERRORB˜™š'
2019-01-14 18:16:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:16:04 [DEBUG   ] Got command RPT from MCS: ref #1168509
2019-01-14 18:16:04 [DEBUG   ] summary = ERROR
2019-01-14 18:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168509  13 58497 65764765 A  ERRORERROR'
2019-01-14 18:16:04 [DEBUG   ] Got command RPT from MCS: ref #1168510
2019-01-14 18:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168510  77 58497 65764766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:16:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:16:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:16:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:16:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:16:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:16:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:16:27 [WARNING ] (13, 1, 'bot')
2019-01-14 18:16:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:16:27 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-14 18:16:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:17:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 18:17:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 18:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:17:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:17:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:17:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:17:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:17:28 [DEBUG   ] Finished updating board flags in 2.228 seconds
2019-01-14 18:17:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:18:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:18:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 18:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:18:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:18:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:18:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:18:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:18:28 [DEBUG   ] Finished updating board flags in 2.204 seconds
2019-01-14 18:18:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:19:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:19:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 18:19:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:19:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:19:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:19:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:19:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:19:28 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-01-14 18:19:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 18:20:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 18:20:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 18:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:20:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:20:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:20:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:20:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:20:28 [DEBUG   ] Finished updating board flags in 2.148 seconds
2019-01-14 18:20:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 18:21:01 [DEBUG   ] Got command RPT from MCS: ref #1168534
2019-01-14 18:21:01 [DEBUG   ] summary = ERROR
2019-01-14 18:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168534  13 58497 66061538 A  ERRORERROR'
2019-01-14 18:21:01 [DEBUG   ] Got command RPT from MCS: ref #1168535
2019-01-14 18:21:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168535  77 58497 66061745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:21:01 [DEBUG   ] Got command RPT from MCS: ref #1168536
2019-01-14 18:21:01 [DEBUG   ] summary = ERROR
2019-01-14 18:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168536  13 58497 66061949 A  ERRORERROR'
2019-01-14 18:21:02 [DEBUG   ] Got command RPT from MCS: ref #1168537
2019-01-14 18:21:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:21:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168537  77 58497 66062141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:21:02 [DEBUG   ] Got command RPT from MCS: ref #1168538
2019-01-14 18:21:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:21:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168538  12 58497 66062345 A  ERRORB˜™š'
2019-01-14 18:21:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 18:21:04 [DEBUG   ] Got command RPT from MCS: ref #1168539
2019-01-14 18:21:04 [DEBUG   ] summary = ERROR
2019-01-14 18:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168539  13 58497 66064765 A  ERRORERROR'
2019-01-14 18:21:04 [DEBUG   ] Got command RPT from MCS: ref #1168540
2019-01-14 18:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168540  77 58497 66064766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:21:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-14 18:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:21:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:21:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:21:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:21:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:21:28 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-14 18:21:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 18:22:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 18:22:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 18:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:22:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:22:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:22:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:22:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:22:28 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-14 18:22:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 18:23:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:23:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 18:23:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:23:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:23:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:23:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:23:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:23:28 [DEBUG   ] Finished updating board flags in 1.863 seconds
2019-01-14 18:23:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 18:24:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 18:24:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:24:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:24:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:24:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:24:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:24:28 [DEBUG   ] Finished updating board flags in 1.755 seconds
2019-01-14 18:24:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 18:25:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:25:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:25:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:25:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:25:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:25:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:25:28 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-14 18:25:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:26:01 [DEBUG   ] Got command RPT from MCS: ref #1168562
2019-01-14 18:26:01 [DEBUG   ] summary = ERROR
2019-01-14 18:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168562  13 58497 66361633 A  ERRORERROR'
2019-01-14 18:26:01 [DEBUG   ] Got command RPT from MCS: ref #1168563
2019-01-14 18:26:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168563  77 58497 66361825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:26:02 [DEBUG   ] Got command RPT from MCS: ref #1168564
2019-01-14 18:26:02 [DEBUG   ] summary = ERROR
2019-01-14 18:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168564  13 58497 66362029 A  ERRORERROR'
2019-01-14 18:26:02 [DEBUG   ] Got command RPT from MCS: ref #1168566
2019-01-14 18:26:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168566  77 58497 66362233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:26:02 [DEBUG   ] Got command RPT from MCS: ref #1168567
2019-01-14 18:26:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168567  12 58497 66362437 A  ERRORB˜™š'
2019-01-14 18:26:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:26:04 [DEBUG   ] Got command RPT from MCS: ref #1168572
2019-01-14 18:26:04 [DEBUG   ] summary = ERROR
2019-01-14 18:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168572  13 58497 66364777 A  ERRORERROR'
2019-01-14 18:26:04 [DEBUG   ] Got command RPT from MCS: ref #1168573
2019-01-14 18:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168573  77 58497 66364778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:26:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:26:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:26:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:26:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:26:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:26:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:26:28 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-14 18:26:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:27:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 18:27:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:27:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:27:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:27:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:27:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:27:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:27:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:27:28 [DEBUG   ] Finished updating board flags in 1.643 seconds
2019-01-14 18:27:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:28:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 18:28:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 18:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:28:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 18:28:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:28:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:28:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:28:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:28:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:28:28 [DEBUG   ] Finished updating board flags in 1.516 seconds
2019-01-14 18:28:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 18:29:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 18:29:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:29:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:29:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:29:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:29:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:29:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:29:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:29:28 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-14 18:29:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:30:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:30:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:30:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:30:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:30:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:30:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:30:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:30:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:30:28 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-01-14 18:30:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:31:01 [DEBUG   ] Got command RPT from MCS: ref #1168597
2019-01-14 18:31:01 [DEBUG   ] summary = ERROR
2019-01-14 18:31:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168597  13 58497 66661717 A  ERRORERROR'
2019-01-14 18:31:01 [DEBUG   ] Got command RPT from MCS: ref #1168598
2019-01-14 18:31:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:31:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168598  77 58497 66661921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:31:02 [DEBUG   ] Got command RPT from MCS: ref #1168599
2019-01-14 18:31:02 [DEBUG   ] summary = ERROR
2019-01-14 18:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168599  13 58497 66662113 A  ERRORERROR'
2019-01-14 18:31:02 [DEBUG   ] Got command RPT from MCS: ref #1168600
2019-01-14 18:31:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168600  77 58497 66662317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:31:02 [DEBUG   ] Got command RPT from MCS: ref #1168601
2019-01-14 18:31:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168601  12 58497 66662521 A  ERRORB˜™š'
2019-01-14 18:31:04 [DEBUG   ] Got command RPT from MCS: ref #1168602
2019-01-14 18:31:04 [DEBUG   ] summary = ERROR
2019-01-14 18:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168602  13 58497 66664769 A  ERRORERROR'
2019-01-14 18:31:04 [DEBUG   ] Got command RPT from MCS: ref #1168603
2019-01-14 18:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168603  77 58497 66664770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:31:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:31:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:31:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:31:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:31:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:31:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:31:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:31:28 [DEBUG   ] Finished updating board flags in 1.509 seconds
2019-01-14 18:31:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:32:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:32:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:32:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 18:32:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:32:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:32:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:32:28 [WARNING ] (13, 1, 'bot')
2019-01-14 18:32:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:32:28 [DEBUG   ] Finished updating board flags in 1.550 seconds
2019-01-14 18:32:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:33:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:33:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:33:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:33:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:33:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:33:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:33:29 [DEBUG   ] Finished updating board flags in 2.163 seconds
2019-01-14 18:33:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:34:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:34:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:34:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:34:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:34:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:34:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:34:29 [DEBUG   ] Finished updating board flags in 1.931 seconds
2019-01-14 18:34:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:35:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:35:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:35:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:35:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:35:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:35:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:35:29 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-14 18:35:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:36:01 [DEBUG   ] Got command RPT from MCS: ref #1168629
2019-01-14 18:36:01 [DEBUG   ] summary = ERROR
2019-01-14 18:36:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168629  13 58497 66961801 A  ERRORERROR'
2019-01-14 18:36:02 [DEBUG   ] Got command RPT from MCS: ref #1168630
2019-01-14 18:36:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168630  77 58497 66962005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:36:02 [DEBUG   ] Got command RPT from MCS: ref #1168631
2019-01-14 18:36:02 [DEBUG   ] summary = ERROR
2019-01-14 18:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168631  13 58497 66962197 A  ERRORERROR'
2019-01-14 18:36:02 [DEBUG   ] Got command RPT from MCS: ref #1168633
2019-01-14 18:36:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168633  77 58497 66962401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:36:02 [DEBUG   ] Got command RPT from MCS: ref #1168634
2019-01-14 18:36:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168634  12 58497 66962605 A  ERRORB˜™š'
2019-01-14 18:36:04 [DEBUG   ] Got command RPT from MCS: ref #1168639
2019-01-14 18:36:04 [DEBUG   ] summary = ERROR
2019-01-14 18:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168639  13 58497 66964777 A  ERRORERROR'
2019-01-14 18:36:04 [DEBUG   ] Got command RPT from MCS: ref #1168640
2019-01-14 18:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168640  77 58497 66964778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:36:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:36:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:36:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:36:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:36:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:36:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:36:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:36:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:36:29 [DEBUG   ] Finished updating board flags in 1.752 seconds
2019-01-14 18:36:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:37:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:37:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:37:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:37:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:37:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:37:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:37:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:37:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:37:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:37:29 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-01-14 18:37:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:38:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:38:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:38:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:38:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:38:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:38:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:38:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:38:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:38:29 [DEBUG   ] Finished updating board flags in 1.660 seconds
2019-01-14 18:38:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:39:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 18:39:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 18:39:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:39:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:39:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:39:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:39:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:39:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:39:29 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-14 18:39:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 18:40:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 18:40:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 18:40:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:40:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:40:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:40:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:40:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:40:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:40:29 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-01-14 18:40:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:41:01 [DEBUG   ] Got command RPT from MCS: ref #1168660
2019-01-14 18:41:01 [DEBUG   ] summary = ERROR
2019-01-14 18:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168660  13 58497 67261893 A  ERRORERROR'
2019-01-14 18:41:02 [DEBUG   ] Got command RPT from MCS: ref #1168661
2019-01-14 18:41:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168661  77 58497 67262085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:41:02 [DEBUG   ] Got command RPT from MCS: ref #1168662
2019-01-14 18:41:02 [DEBUG   ] summary = ERROR
2019-01-14 18:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168662  13 58497 67262289 A  ERRORERROR'
2019-01-14 18:41:02 [DEBUG   ] Got command RPT from MCS: ref #1168663
2019-01-14 18:41:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168663  77 58497 67262493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:41:02 [DEBUG   ] Got command RPT from MCS: ref #1168664
2019-01-14 18:41:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168664  12 58497 67262685 A  ERRORB˜™š'
2019-01-14 18:41:04 [DEBUG   ] Got command RPT from MCS: ref #1168665
2019-01-14 18:41:04 [DEBUG   ] summary = ERROR
2019-01-14 18:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168665  13 58497 67264781 A  ERRORERROR'
2019-01-14 18:41:04 [DEBUG   ] Got command RPT from MCS: ref #1168666
2019-01-14 18:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168666  77 58497 67264782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:41:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:41:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:41:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:41:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:41:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:41:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:41:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:41:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:41:29 [DEBUG   ] Finished updating board flags in 1.473 seconds
2019-01-14 18:41:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:42:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:42:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:42:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:42:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:42:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:42:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:42:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:42:29 [DEBUG   ] Finished updating board flags in 1.485 seconds
2019-01-14 18:42:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 18:43:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:43:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:43:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:43:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:43:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:43:29 [WARNING ] (13, 1, 'bot')
2019-01-14 18:43:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:43:29 [DEBUG   ] Finished updating board flags in 1.506 seconds
2019-01-14 18:43:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:44:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:44:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:44:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:44:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:44:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:44:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:44:30 [DEBUG   ] Finished updating board flags in 2.207 seconds
2019-01-14 18:44:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:45:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:45:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 18:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:45:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:45:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:45:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:45:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:45:30 [DEBUG   ] Finished updating board flags in 2.250 seconds
2019-01-14 18:45:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:46:01 [DEBUG   ] Got command RPT from MCS: ref #1168692
2019-01-14 18:46:01 [DEBUG   ] summary = ERROR
2019-01-14 18:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168692  13 58497 67561973 A  ERRORERROR'
2019-01-14 18:46:02 [DEBUG   ] Got command RPT from MCS: ref #1168693
2019-01-14 18:46:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168693  77 58497 67562177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:46:02 [DEBUG   ] Got command RPT from MCS: ref #1168694
2019-01-14 18:46:02 [DEBUG   ] summary = ERROR
2019-01-14 18:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168694  13 58497 67562369 A  ERRORERROR'
2019-01-14 18:46:02 [DEBUG   ] Got command RPT from MCS: ref #1168696
2019-01-14 18:46:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168696  77 58497 67562573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:46:02 [DEBUG   ] Got command RPT from MCS: ref #1168697
2019-01-14 18:46:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168697  12 58497 67562777 A  ERRORB™™š'
2019-01-14 18:46:04 [DEBUG   ] Got command RPT from MCS: ref #1168702
2019-01-14 18:46:04 [DEBUG   ] summary = ERROR
2019-01-14 18:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168702  13 58497 67564773 A  ERRORERROR'
2019-01-14 18:46:04 [DEBUG   ] Got command RPT from MCS: ref #1168703
2019-01-14 18:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168703  77 58497 67564774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:46:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:46:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:46:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:46:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:46:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:46:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:46:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:46:30 [DEBUG   ] Finished updating board flags in 2.090 seconds
2019-01-14 18:46:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:47:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:47:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:47:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:47:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 18:47:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:47:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:47:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:47:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:47:30 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-01-14 18:47:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:48:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 18:48:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:48:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:48:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:48:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:48:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:48:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:48:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:48:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:48:30 [DEBUG   ] Finished updating board flags in 1.969 seconds
2019-01-14 18:48:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:49:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:49:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:49:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:49:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:49:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:49:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:49:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:49:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:49:30 [DEBUG   ] Finished updating board flags in 1.839 seconds
2019-01-14 18:49:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:50:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:50:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:50:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:50:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:50:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:50:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:50:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:50:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:50:30 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-01-14 18:50:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 18:51:02 [DEBUG   ] Got command RPT from MCS: ref #1168727
2019-01-14 18:51:02 [DEBUG   ] summary = ERROR
2019-01-14 18:51:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168727  13 58497 67862061 A  ERRORERROR'
2019-01-14 18:51:02 [DEBUG   ] Got command RPT from MCS: ref #1168728
2019-01-14 18:51:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:51:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168728  77 58497 67862257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:51:02 [DEBUG   ] Got command RPT from MCS: ref #1168729
2019-01-14 18:51:02 [DEBUG   ] summary = ERROR
2019-01-14 18:51:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168729  13 58497 67862461 A  ERRORERROR'
2019-01-14 18:51:02 [DEBUG   ] Got command RPT from MCS: ref #1168730
2019-01-14 18:51:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:51:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168730  77 58497 67862665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:51:02 [DEBUG   ] Got command RPT from MCS: ref #1168731
2019-01-14 18:51:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:51:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168731  12 58497 67862857 A  ERRORB˜™š'
2019-01-14 18:51:04 [DEBUG   ] Got command RPT from MCS: ref #1168732
2019-01-14 18:51:04 [DEBUG   ] summary = ERROR
2019-01-14 18:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168732  13 58497 67864777 A  ERRORERROR'
2019-01-14 18:51:04 [DEBUG   ] Got command RPT from MCS: ref #1168733
2019-01-14 18:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168733  77 58497 67864778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:51:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 18:51:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 18:51:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:51:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:51:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:51:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:51:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:51:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:51:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:51:30 [DEBUG   ] Finished updating board flags in 1.739 seconds
2019-01-14 18:51:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 18:52:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 18:52:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 18:52:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:52:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:52:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:52:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:52:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:52:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:52:30 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-14 18:52:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 18:53:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 18:53:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 18:53:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:53:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:53:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:53:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:53:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:53:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:53:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:53:30 [DEBUG   ] Finished updating board flags in 1.483 seconds
2019-01-14 18:53:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-14 18:54:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 18:54:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:54:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:54:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:54:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:54:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:54:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:54:30 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-14 18:54:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:55:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:55:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:55:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 18:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:55:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 18:55:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:55:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:55:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:55:30 [WARNING ] (13, 1, 'bot')
2019-01-14 18:55:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:55:30 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-14 18:55:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:56:02 [DEBUG   ] Got command RPT from MCS: ref #1168755
2019-01-14 18:56:02 [DEBUG   ] summary = ERROR
2019-01-14 18:56:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168755  13 58497 68162149 A  ERRORERROR'
2019-01-14 18:56:02 [DEBUG   ] Got command RPT from MCS: ref #1168756
2019-01-14 18:56:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:56:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168756  77 58497 68162353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:56:02 [DEBUG   ] Got command RPT from MCS: ref #1168757
2019-01-14 18:56:02 [DEBUG   ] summary = ERROR
2019-01-14 18:56:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168757  13 58497 68162545 A  ERRORERROR'
2019-01-14 18:56:02 [DEBUG   ] Got command RPT from MCS: ref #1168759
2019-01-14 18:56:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:56:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168759  77 58497 68162749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:56:02 [DEBUG   ] Got command RPT from MCS: ref #1168761
2019-01-14 18:56:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 18:56:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168761  12 58497 68162953 A  ERRORB˜™š'
2019-01-14 18:56:04 [DEBUG   ] Got command RPT from MCS: ref #1168765
2019-01-14 18:56:04 [DEBUG   ] summary = ERROR
2019-01-14 18:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168765  13 58497 68164777 A  ERRORERROR'
2019-01-14 18:56:04 [DEBUG   ] Got command RPT from MCS: ref #1168766
2019-01-14 18:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 18:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168766  77 58497 68164778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 18:56:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:56:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:56:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 18:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:56:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:56:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:56:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:56:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:56:31 [DEBUG   ] Finished updating board flags in 2.186 seconds
2019-01-14 18:56:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:57:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:57:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:57:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 18:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:57:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:57:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:57:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:57:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:57:31 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-14 18:57:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:58:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 18:58:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:58:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-14 18:58:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:58:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:58:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:58:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:58:31 [DEBUG   ] Finished updating board flags in 1.893 seconds
2019-01-14 18:58:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 18:59:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 18:59:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 18:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 18:59:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:59:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:59:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:59:31 [WARNING ] (13, 1, 'bot')
2019-01-14 18:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 18:59:31 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-14 18:59:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:00:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 19:00:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:00:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:00:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:00:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:00:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:00:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:00:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:00:31 [DEBUG   ] Finished updating board flags in 1.714 seconds
2019-01-14 19:00:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:01:02 [DEBUG   ] Got command RPT from MCS: ref #1168790
2019-01-14 19:01:02 [DEBUG   ] summary = ERROR
2019-01-14 19:01:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168790  13 58497 68462233 A  ERRORERROR'
2019-01-14 19:01:02 [DEBUG   ] Got command RPT from MCS: ref #1168791
2019-01-14 19:01:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:01:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168791  77 58497 68462437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:01:02 [DEBUG   ] Got command RPT from MCS: ref #1168792
2019-01-14 19:01:02 [DEBUG   ] summary = ERROR
2019-01-14 19:01:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168792  13 58497 68462641 A  ERRORERROR'
2019-01-14 19:01:02 [DEBUG   ] Got command RPT from MCS: ref #1168793
2019-01-14 19:01:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:01:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168793  77 58497 68462833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:01:03 [DEBUG   ] Got command RPT from MCS: ref #1168794
2019-01-14 19:01:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168794  12 58497 68463037 A  ERRORB™™š'
2019-01-14 19:01:04 [DEBUG   ] Got command RPT from MCS: ref #1168795
2019-01-14 19:01:04 [DEBUG   ] summary = ERROR
2019-01-14 19:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168795  13 58497 68464777 A  ERRORERROR'
2019-01-14 19:01:04 [DEBUG   ] Got command RPT from MCS: ref #1168796
2019-01-14 19:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168796  77 58497 68464778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:01:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:01:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 19:01:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:01:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:01:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:01:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:01:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:01:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:01:31 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-14 19:01:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:02:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:02:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:02:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:02:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:02:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:02:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:02:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:02:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:02:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:02:31 [DEBUG   ] Finished updating board flags in 1.575 seconds
2019-01-14 19:02:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:03:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 19:03:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:03:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:03:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:03:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:03:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:03:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:03:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:03:31 [DEBUG   ] Finished updating board flags in 1.494 seconds
2019-01-14 19:03:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:04:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:04:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:04:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:04:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:04:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:04:31 [WARNING ] (13, 1, 'bot')
2019-01-14 19:04:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:04:31 [DEBUG   ] Finished updating board flags in 1.557 seconds
2019-01-14 19:04:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:05:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:05:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 19:05:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:05:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:05:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:05:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:05:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:05:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:05:32 [DEBUG   ] Finished updating board flags in 2.261 seconds
2019-01-14 19:05:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:06:02 [DEBUG   ] Got command RPT from MCS: ref #1168822
2019-01-14 19:06:02 [DEBUG   ] summary = ERROR
2019-01-14 19:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168822  13 58497 68762325 A  ERRORERROR'
2019-01-14 19:06:02 [DEBUG   ] Got command RPT from MCS: ref #1168823
2019-01-14 19:06:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168823  77 58497 68762517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:06:02 [DEBUG   ] Got command RPT from MCS: ref #1168824
2019-01-14 19:06:02 [DEBUG   ] summary = ERROR
2019-01-14 19:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168824  13 58497 68762721 A  ERRORERROR'
2019-01-14 19:06:02 [DEBUG   ] Got command RPT from MCS: ref #1168826
2019-01-14 19:06:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168826  77 58497 68762925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:06:03 [DEBUG   ] Got command RPT from MCS: ref #1168828
2019-01-14 19:06:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:06:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168828  12 58497 68763129 A  ERRORB™™š'
2019-01-14 19:06:04 [DEBUG   ] Got command RPT from MCS: ref #1168832
2019-01-14 19:06:04 [DEBUG   ] summary = ERROR
2019-01-14 19:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168832  13 58497 68764785 A  ERRORERROR'
2019-01-14 19:06:04 [DEBUG   ] Got command RPT from MCS: ref #1168833
2019-01-14 19:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168833  77 58497 68764786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:06:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:06:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:06:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:06:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:06:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:06:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:06:32 [DEBUG   ] Finished updating board flags in 2.116 seconds
2019-01-14 19:06:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 19:07:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:07:11 [DEBUG   ] Got command TBW from MCS: ref #1168850
2019-01-14 19:07:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-14 19:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1168850   8 58497 68831126 A  ERROR'
2019-01-14 19:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-14 19:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-14 19:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-14 19:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-14 19:07:14 [DEBUG   ] spawn_process: at 2019-01-14 19:07:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-14 19:07:14 [INFO    ] Finished spawning TBW
2019-01-14 19:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:07:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:07:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:07:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:07:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:07:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:07:32 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-14 19:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:08:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:08:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:08:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:08:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:08:32 [DEBUG   ] Finished updating board flags in 1.941 seconds
2019-01-14 19:09:02 [INFO    ] __waitForTBW - TBW finished in 108.223 s
2019-01-14 19:09:03 [DEBUG   ] Finished updating ant stats in 0.412 seconds
2019-01-14 19:09:03 [INFO    ] Started antennas statistics background thread
2019-01-14 19:09:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547492945']
2019-01-14 19:09:03 [DEBUG   ] spawn_process: at 2019-01-14 19:09:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547492945']
2019-01-14 19:09:03 [INFO    ] Finished spawning TBN in 0.072 s
2019-01-14 19:09:23 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2019-01-14 19:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:09:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:09:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:09:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:09:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:09:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:09:32 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-14 19:09:44 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-14 19:10:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 19:10:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-14 19:10:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:10:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:10:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:10:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:10:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:10:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:10:32 [DEBUG   ] Finished updating board flags in 1.666 seconds
2019-01-14 19:10:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 19:11:02 [DEBUG   ] Got command RPT from MCS: ref #1168862
2019-01-14 19:11:02 [DEBUG   ] summary = ERROR
2019-01-14 19:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168862  13 58497 69062405 A  ERRORERROR'
2019-01-14 19:11:02 [DEBUG   ] Got command RPT from MCS: ref #1168863
2019-01-14 19:11:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168863  77 58497 69062609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:11:02 [DEBUG   ] Got command RPT from MCS: ref #1168864
2019-01-14 19:11:02 [DEBUG   ] summary = ERROR
2019-01-14 19:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168864  13 58497 69062813 A  ERRORERROR'
2019-01-14 19:11:03 [DEBUG   ] Got command RPT from MCS: ref #1168865
2019-01-14 19:11:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:11:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168865  77 58497 69063005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:11:03 [DEBUG   ] Got command RPT from MCS: ref #1168866
2019-01-14 19:11:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:11:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168866  12 58497 69063209 A  ERRORB˜™š'
2019-01-14 19:11:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 19:11:04 [DEBUG   ] Got command RPT from MCS: ref #1168867
2019-01-14 19:11:04 [DEBUG   ] summary = ERROR
2019-01-14 19:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168867  13 58497 69064781 A  ERRORERROR'
2019-01-14 19:11:04 [DEBUG   ] Got command RPT from MCS: ref #1168868
2019-01-14 19:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168868  77 58497 69064782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:11:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:11:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:11:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:11:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:11:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:11:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:11:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:11:32 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-14 19:11:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-14 19:12:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:12:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 19:12:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:12:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:12:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:12:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:12:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:12:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:12:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:12:32 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-14 19:12:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 19:13:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:13:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 19:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:13:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:13:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:13:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:13:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:13:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:13:32 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-14 19:13:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 19:14:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 19:14:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 19:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:14:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:14:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:14:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:14:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:14:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:14:32 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-14 19:14:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 19:15:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:15:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:15:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:15:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:15:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:15:32 [WARNING ] (13, 1, 'bot')
2019-01-14 19:15:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:15:32 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-01-14 19:15:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 19:16:02 [DEBUG   ] Got command RPT from MCS: ref #1168894
2019-01-14 19:16:02 [DEBUG   ] summary = ERROR
2019-01-14 19:16:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168894  13 58497 69362489 A  ERRORERROR'
2019-01-14 19:16:02 [DEBUG   ] Got command RPT from MCS: ref #1168895
2019-01-14 19:16:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:16:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168895  77 58497 69362693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:16:02 [DEBUG   ] Got command RPT from MCS: ref #1168896
2019-01-14 19:16:02 [DEBUG   ] summary = ERROR
2019-01-14 19:16:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168896  13 58497 69362897 A  ERRORERROR'
2019-01-14 19:16:03 [DEBUG   ] Got command RPT from MCS: ref #1168898
2019-01-14 19:16:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168898  77 58497 69363089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:16:03 [DEBUG   ] Got command RPT from MCS: ref #1168899
2019-01-14 19:16:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168899  12 58497 69363293 A  ERRORB—™š'
2019-01-14 19:16:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:16:04 [DEBUG   ] Got command RPT from MCS: ref #1168904
2019-01-14 19:16:04 [DEBUG   ] summary = ERROR
2019-01-14 19:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168904  13 58497 69364781 A  ERRORERROR'
2019-01-14 19:16:04 [DEBUG   ] Got command RPT from MCS: ref #1168905
2019-01-14 19:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168905  77 58497 69364782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:16:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:16:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:16:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:16:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:16:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:16:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:16:33 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-01-14 19:16:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:17:04 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-14 19:17:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 19:17:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:17:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:17:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:17:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:17:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:17:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:17:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:17:33 [DEBUG   ] Finished updating board flags in 1.937 seconds
2019-01-14 19:17:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 19:18:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 19:18:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:18:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:18:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:18:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:18:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:18:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:18:33 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-14 19:18:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:19:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 19:19:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:19:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:19:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 19:19:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:19:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:19:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:19:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:19:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:19:33 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-14 19:19:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 19:20:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 19:20:25 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-14 19:20:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:20:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:20:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:20:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:20:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:20:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:20:33 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-14 19:20:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:21:02 [DEBUG   ] Got command RPT from MCS: ref #1168929
2019-01-14 19:21:02 [DEBUG   ] summary = ERROR
2019-01-14 19:21:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168929  13 58497 69662573 A  ERRORERROR'
2019-01-14 19:21:02 [DEBUG   ] Got command RPT from MCS: ref #1168930
2019-01-14 19:21:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:21:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168930  77 58497 69662777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:21:02 [DEBUG   ] Got command RPT from MCS: ref #1168931
2019-01-14 19:21:02 [DEBUG   ] summary = ERROR
2019-01-14 19:21:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168931  13 58497 69662969 A  ERRORERROR'
2019-01-14 19:21:03 [DEBUG   ] Got command RPT from MCS: ref #1168932
2019-01-14 19:21:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:21:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168932  77 58497 69663173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:21:03 [DEBUG   ] Got command RPT from MCS: ref #1168933
2019-01-14 19:21:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:21:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168933  12 58497 69663377 A  ERRORB™™š'
2019-01-14 19:21:04 [DEBUG   ] Got command RPT from MCS: ref #1168934
2019-01-14 19:21:04 [DEBUG   ] summary = ERROR
2019-01-14 19:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168934  13 58497 69664782 A  ERRORERROR'
2019-01-14 19:21:04 [DEBUG   ] Got command RPT from MCS: ref #1168935
2019-01-14 19:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168935  77 58497 69664782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:21:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:21:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:21:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:21:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:21:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:21:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:21:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:21:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:21:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:21:33 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-14 19:21:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 19:22:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:22:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:22:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:22:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 19:22:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:22:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:22:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:22:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:22:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:22:33 [DEBUG   ] Finished updating board flags in 1.446 seconds
2019-01-14 19:22:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:23:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:23:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:23:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:23:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:23:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:23:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:23:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:23:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:23:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:23:33 [DEBUG   ] Finished updating board flags in 1.436 seconds
2019-01-14 19:23:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:24:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:24:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 19:24:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:24:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:24:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:24:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:24:33 [WARNING ] (13, 1, 'bot')
2019-01-14 19:24:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:24:33 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-14 19:24:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:25:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 19:25:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 19:25:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:25:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:25:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:25:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:25:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:25:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:25:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:25:34 [DEBUG   ] Finished updating board flags in 2.273 seconds
2019-01-14 19:25:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 19:26:02 [DEBUG   ] Got command RPT from MCS: ref #1168957
2019-01-14 19:26:02 [DEBUG   ] summary = ERROR
2019-01-14 19:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168957  13 58497 69962653 A  ERRORERROR'
2019-01-14 19:26:02 [DEBUG   ] Got command RPT from MCS: ref #1168958
2019-01-14 19:26:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168958  77 58497 69962857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:26:03 [DEBUG   ] Got command RPT from MCS: ref #1168959
2019-01-14 19:26:03 [DEBUG   ] summary = ERROR
2019-01-14 19:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168959  13 58497 69963061 A  ERRORERROR'
2019-01-14 19:26:03 [DEBUG   ] Got command RPT from MCS: ref #1168961
2019-01-14 19:26:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168961  77 58497 69963265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:26:03 [DEBUG   ] Got command RPT from MCS: ref #1168962
2019-01-14 19:26:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168962  12 58497 69963457 A  ERRORB™™š'
2019-01-14 19:26:04 [DEBUG   ] Got command RPT from MCS: ref #1168967
2019-01-14 19:26:04 [DEBUG   ] summary = ERROR
2019-01-14 19:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168967  13 58497 69964789 A  ERRORERROR'
2019-01-14 19:26:04 [DEBUG   ] Got command RPT from MCS: ref #1168968
2019-01-14 19:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168968  77 58497 69964790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:26:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 19:26:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 19:26:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:26:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 19:26:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:26:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:26:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:26:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:26:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:26:34 [DEBUG   ] Finished updating board flags in 2.074 seconds
2019-01-14 19:26:46 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-14 19:27:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 19:27:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:27:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:27:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:27:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:27:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:27:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:27:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:27:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:27:34 [DEBUG   ] Finished updating board flags in 2.027 seconds
2019-01-14 19:27:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 19:28:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:28:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:28:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:28:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:28:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:28:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:28:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:28:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:28:34 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-14 19:28:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 19:29:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 19:29:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 19:29:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:29:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:29:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:29:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:29:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:29:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:29:34 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-14 19:29:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:30:07 [DEBUG   ] Finished updating ant stats in 1.803 seconds
2019-01-14 19:30:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:30:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:30:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:30:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:30:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:30:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:30:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:30:34 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-14 19:30:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-14 19:31:02 [DEBUG   ] Got command RPT from MCS: ref #1168992
2019-01-14 19:31:02 [DEBUG   ] summary = ERROR
2019-01-14 19:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168992  13 58497 70262749 A  ERRORERROR'
2019-01-14 19:31:02 [DEBUG   ] Got command RPT from MCS: ref #1168993
2019-01-14 19:31:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168993  77 58497 70262941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:31:03 [DEBUG   ] Got command RPT from MCS: ref #1168994
2019-01-14 19:31:03 [DEBUG   ] summary = ERROR
2019-01-14 19:31:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168994  13 58497 70263145 A  ERRORERROR'
2019-01-14 19:31:03 [DEBUG   ] Got command RPT from MCS: ref #1168995
2019-01-14 19:31:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:31:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168995  77 58497 70263349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:31:03 [DEBUG   ] Got command RPT from MCS: ref #1168996
2019-01-14 19:31:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:31:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168996  12 58497 70263541 A  ERRORB˜™š'
2019-01-14 19:31:04 [DEBUG   ] Got command RPT from MCS: ref #1168997
2019-01-14 19:31:04 [DEBUG   ] summary = ERROR
2019-01-14 19:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168997  13 58497 70264789 A  ERRORERROR'
2019-01-14 19:31:04 [DEBUG   ] Got command RPT from MCS: ref #1168998
2019-01-14 19:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1168998  77 58497 70264790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:31:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:31:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 19:31:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:31:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:31:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:31:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:31:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:31:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:31:34 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-14 19:31:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 19:32:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:32:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:32:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:32:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:32:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:32:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:32:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:32:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:32:34 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-14 19:32:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:33:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:33:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-14 19:33:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:33:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:33:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:33:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:33:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:33:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:33:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:33:34 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-14 19:33:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:34:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:34:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 19:34:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:34:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:34:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:34:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:34:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:34:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:34:34 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-01-14 19:34:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 19:35:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 19:35:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:35:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 19:35:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:35:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:35:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:35:34 [WARNING ] (13, 1, 'bot')
2019-01-14 19:35:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:35:34 [DEBUG   ] Finished updating board flags in 1.492 seconds
2019-01-14 19:35:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:36:02 [DEBUG   ] Got command RPT from MCS: ref #1169024
2019-01-14 19:36:02 [DEBUG   ] summary = ERROR
2019-01-14 19:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169024  13 58497 70562825 A  ERRORERROR'
2019-01-14 19:36:03 [DEBUG   ] Got command RPT from MCS: ref #1169025
2019-01-14 19:36:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169025  77 58497 70563029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:36:03 [DEBUG   ] Got command RPT from MCS: ref #1169026
2019-01-14 19:36:03 [DEBUG   ] summary = ERROR
2019-01-14 19:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169026  13 58497 70563233 A  ERRORERROR'
2019-01-14 19:36:03 [DEBUG   ] Got command RPT from MCS: ref #1169028
2019-01-14 19:36:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169028  77 58497 70563437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:36:03 [DEBUG   ] Got command RPT from MCS: ref #1169029
2019-01-14 19:36:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169029  12 58497 70563629 A  ERRORB˜™š'
2019-01-14 19:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169034
2019-01-14 19:36:04 [DEBUG   ] summary = ERROR
2019-01-14 19:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169034  13 58497 70564793 A  ERRORERROR'
2019-01-14 19:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169035
2019-01-14 19:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169035  77 58497 70564794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:36:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:36:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 19:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:36:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 19:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:36:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:36:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:36:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:36:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:36:35 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-14 19:36:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 19:37:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:37:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 19:37:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 19:37:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:37:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:37:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:37:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:37:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:37:35 [DEBUG   ] Finished updating board flags in 2.162 seconds
2019-01-14 19:37:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 19:38:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 19:38:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:38:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:38:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:38:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:38:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:38:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:38:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:38:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:38:35 [DEBUG   ] Finished updating board flags in 1.882 seconds
2019-01-14 19:38:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:39:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 19:39:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:39:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:39:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:39:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:39:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:39:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:39:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:39:35 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-14 19:39:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:40:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 19:40:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 19:40:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:40:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:40:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:40:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:40:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:40:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:40:35 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-14 19:40:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 19:41:02 [DEBUG   ] Got command RPT from MCS: ref #1169055
2019-01-14 19:41:02 [DEBUG   ] summary = ERROR
2019-01-14 19:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169055  13 58497 70862909 A  ERRORERROR'
2019-01-14 19:41:03 [DEBUG   ] Got command RPT from MCS: ref #1169056
2019-01-14 19:41:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:41:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169056  77 58497 70863113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:41:03 [DEBUG   ] Got command RPT from MCS: ref #1169057
2019-01-14 19:41:03 [DEBUG   ] summary = ERROR
2019-01-14 19:41:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169057  13 58497 70863317 A  ERRORERROR'
2019-01-14 19:41:03 [DEBUG   ] Got command RPT from MCS: ref #1169058
2019-01-14 19:41:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:41:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169058  77 58497 70863521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:41:03 [DEBUG   ] Got command RPT from MCS: ref #1169059
2019-01-14 19:41:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:41:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169059  12 58497 70863713 A  ERRORB™™š'
2019-01-14 19:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169060
2019-01-14 19:41:04 [DEBUG   ] summary = ERROR
2019-01-14 19:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169060  13 58497 70864793 A  ERRORERROR'
2019-01-14 19:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169061
2019-01-14 19:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169061  77 58497 70864794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:41:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:41:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:41:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:41:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:41:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 19:41:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:41:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:41:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:41:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:41:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:41:35 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-14 19:41:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:42:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:42:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:42:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:42:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:42:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:42:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:42:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:42:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:42:35 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-14 19:42:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:43:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:43:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 19:43:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:43:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:43:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:43:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:43:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:43:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:43:35 [DEBUG   ] Finished updating board flags in 1.505 seconds
2019-01-14 19:43:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 19:44:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 19:44:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 19:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:44:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:44:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:44:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:44:35 [WARNING ] (13, 1, 'bot')
2019-01-14 19:44:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:44:35 [DEBUG   ] Finished updating board flags in 1.510 seconds
2019-01-14 19:44:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 19:45:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:45:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:45:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:45:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:45:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:45:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:45:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:45:36 [DEBUG   ] Finished updating board flags in 2.268 seconds
2019-01-14 19:45:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 19:46:02 [DEBUG   ] Got command RPT from MCS: ref #1169087
2019-01-14 19:46:02 [DEBUG   ] summary = ERROR
2019-01-14 19:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169087  13 58497 71162997 A  ERRORERROR'
2019-01-14 19:46:03 [DEBUG   ] Got command RPT from MCS: ref #1169088
2019-01-14 19:46:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:46:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169088  77 58497 71163201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:46:03 [DEBUG   ] Got command RPT from MCS: ref #1169089
2019-01-14 19:46:03 [DEBUG   ] summary = ERROR
2019-01-14 19:46:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169089  13 58497 71163405 A  ERRORERROR'
2019-01-14 19:46:03 [DEBUG   ] Got command RPT from MCS: ref #1169091
2019-01-14 19:46:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:46:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169091  77 58497 71163597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:46:03 [DEBUG   ] Got command RPT from MCS: ref #1169092
2019-01-14 19:46:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:46:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169092  12 58497 71163801 A  ERRORB˜™š'
2019-01-14 19:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169097
2019-01-14 19:46:04 [DEBUG   ] summary = ERROR
2019-01-14 19:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169097  13 58497 71164785 A  ERRORERROR'
2019-01-14 19:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169098
2019-01-14 19:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169098  77 58497 71164786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:46:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:46:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:46:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:46:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 19:46:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:46:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:46:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:46:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:46:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:46:36 [DEBUG   ] Finished updating board flags in 2.117 seconds
2019-01-14 19:46:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 19:47:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 19:47:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:47:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:47:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:47:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:47:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:47:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:47:36 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-14 19:47:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:48:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 19:48:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 19:48:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:48:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:48:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:48:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:48:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:48:36 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-14 19:48:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 19:49:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 19:49:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 19:49:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:49:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:49:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:49:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:49:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:49:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:49:36 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-14 19:49:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 19:50:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 19:50:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 19:50:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 19:50:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:50:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:50:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:50:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:50:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:50:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:50:36 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-01-14 19:50:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 19:51:03 [DEBUG   ] Got command RPT from MCS: ref #1169122
2019-01-14 19:51:03 [DEBUG   ] summary = ERROR
2019-01-14 19:51:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169122  13 58497 71463081 A  ERRORERROR'
2019-01-14 19:51:03 [DEBUG   ] Got command RPT from MCS: ref #1169123
2019-01-14 19:51:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:51:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169123  77 58497 71463285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:51:03 [DEBUG   ] Got command RPT from MCS: ref #1169124
2019-01-14 19:51:03 [DEBUG   ] summary = ERROR
2019-01-14 19:51:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169124  13 58497 71463489 A  ERRORERROR'
2019-01-14 19:51:03 [DEBUG   ] Got command RPT from MCS: ref #1169125
2019-01-14 19:51:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:51:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169125  77 58497 71463693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:51:03 [DEBUG   ] Got command RPT from MCS: ref #1169126
2019-01-14 19:51:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 19:51:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169126  12 58497 71463885 A  ERRORB˜™š'
2019-01-14 19:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169127
2019-01-14 19:51:04 [DEBUG   ] summary = ERROR
2019-01-14 19:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169127  13 58497 71464797 A  ERRORERROR'
2019-01-14 19:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169128
2019-01-14 19:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169128  77 58497 71464798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:51:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:51:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 19:51:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:51:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:51:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:51:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:51:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:51:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:51:36 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-14 19:51:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 19:52:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 19:52:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 19:52:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:52:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:52:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:52:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:52:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:52:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:52:36 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-14 19:52:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 19:53:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 19:53:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 19:53:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:53:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 19:53:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:53:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:53:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:53:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:53:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:53:36 [DEBUG   ] Finished updating board flags in 1.446 seconds
2019-01-14 19:53:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:54:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:54:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 19:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:54:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:54:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:54:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:54:36 [WARNING ] (13, 1, 'bot')
2019-01-14 19:54:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:54:36 [DEBUG   ] Finished updating board flags in 1.556 seconds
2019-01-14 19:54:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 19:55:00 [DEBUG   ] Got command RPT from MCS: ref #1169148
2019-01-14 19:55:00 [DEBUG   ] summary = ERROR
2019-01-14 19:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169148  13 58497 71700565 A  ERRORERROR'
2019-01-14 19:55:00 [DEBUG   ] Got command RPT from MCS: ref #1169149
2019-01-14 19:55:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169149  77 58497 71700566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:55:05 [DEBUG   ] Got command INI from MCS: ref #1169150
2019-01-14 19:55:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-14 19:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1169150   8 58497 71705574 ABOOTING'
2019-01-14 19:55:09 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2019-01-14 19:55:29 [INFO    ] -------------------
2019-01-14 19:55:29 [INFO    ]  LWA board status
2019-01-14 19:55:29 [INFO    ] -------------------
2019-01-14 19:55:29 [INFO    ] DP 1: 2 lwa27
2019-01-14 19:55:29 [INFO    ] DP 1: 3 lwa24
2019-01-14 19:55:29 [INFO    ] DP 1: 4 lwa23
2019-01-14 19:55:29 [INFO    ] DP 1: 5 lwa18
2019-01-14 19:55:29 [INFO    ] DP 1: 6 lwa10
2019-01-14 19:55:29 [INFO    ] DP 1: 7 lwa32
2019-01-14 19:55:29 [INFO    ] DP 1: 8 lwa11
2019-01-14 19:55:29 [INFO    ] DP 1: 9 lwa30
2019-01-14 19:55:29 [INFO    ] DP 1: 10 lwa12
2019-01-14 19:55:29 [INFO    ] DP 1: 11 lwa8
2019-01-14 19:55:29 [INFO    ] DP 1: 12 lwa13
2019-01-14 19:55:29 [INFO    ] DP 1: 13 lwa26
2019-01-14 19:55:29 [INFO    ] DP 1: 14 lwa14
2019-01-14 19:55:29 [INFO    ] DP 1: 16 lwa22
2019-01-14 19:55:29 [INFO    ] DP 1: 17 lwa20
2019-01-14 19:55:29 [INFO    ] DP 1: 18 lwa1
2019-01-14 19:55:29 [INFO    ] DP 1: 19 lwa5
2019-01-14 19:55:29 [INFO    ] DP 1: 20 lwa25
2019-01-14 19:55:29 [INFO    ] DP 1: 21 lwa35
2019-01-14 19:55:29 [INFO    ] DP 1: 22 lwa19
2019-01-14 19:55:29 [INFO    ] DP 1: 23 lwa21
2019-01-14 19:55:29 [INFO    ] DP 1: 24 lwa6
2019-01-14 19:55:29 [INFO    ] DP 1: 25 lwa7
2019-01-14 19:55:29 [INFO    ] DP 1: 26 lwa33
2019-01-14 19:55:29 [INFO    ] DP 1: 27 lwa15
2019-01-14 19:55:29 [INFO    ] DP 1: 28 lwa28
2019-01-14 19:55:29 [INFO    ] DP 2: 1 lwa16
2019-01-14 19:55:29 [INFO    ] DP 2: 15 lwa34
2019-01-14 19:55:29 [INFO    ] Total of 28 boards
2019-01-14 19:55:29 [INFO    ] Total of 260 stands
2019-01-14 19:55:29 [INFO    ] -------------------
2019-01-14 19:55:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22224
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22225
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22226
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22227
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22228
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22229
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22230
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22231
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22232
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22233
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22234
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22235
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22236
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22237
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22238
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22239
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22240
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22241
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22242
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22243
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22244
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22245
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22246
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22247
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22248
2019-01-14 19:55:36 [DEBUG   ] 2019-01-14 19:55:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22249
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22224 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22225 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22226 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22227 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22228 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22229 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22230 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22231 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22232 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22233 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22234 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22235 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22236 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22237 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22238 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22239 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22240 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22241 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22242 exited with status 0
2019-01-14 19:55:48 [DEBUG   ] 2019-01-14 19:55:48 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22243 exited with status 0
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22244 exited with status 0
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22245 exited with status 0
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22246 exited with status 0
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22247 exited with status 0
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22248 exited with status 0
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22249 exited with status 0
2019-01-14 19:55:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] spawn_process: at 2019-01-14 19:55:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22276
2019-01-14 19:55:49 [DEBUG   ] 2019-01-14 19:55:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22277
2019-01-14 19:55:54 [DEBUG   ] 2019-01-14 19:55:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22276 exited with status 0
2019-01-14 19:55:54 [DEBUG   ] 2019-01-14 19:55:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22277 exited with status 0
2019-01-14 19:55:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-14 19:55:54 [DEBUG   ] spawn_process: at 2019-01-14 19:55:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-14 19:55:54 [DEBUG   ] spawn_process: at 2019-01-14 19:55:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-14 19:55:54 [INFO    ] Setting Beam 1 xbars
2019-01-14 19:55:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-14 19:55:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-14 19:55:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-14 19:55:54 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-14 19:55:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-14 19:55:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-14 19:55:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-14 19:55:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-14 19:55:58 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-14 19:55:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-14 19:56:00 [INFO    ] Setting Beam 2 xbars
2019-01-14 19:56:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-14 19:56:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-14 19:56:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-14 19:56:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-14 19:56:03 [DEBUG   ] Got command RPT from MCS: ref #1169153
2019-01-14 19:56:03 [DEBUG   ] summary = BOOTING
2019-01-14 19:56:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169153  15 58497 71763170 ABOOTINGBOOTING'
2019-01-14 19:56:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-14 19:56:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-14 19:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169159
2019-01-14 19:56:04 [DEBUG   ] summary = BOOTING
2019-01-14 19:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169159  15 58497 71764790 ABOOTINGBOOTING'
2019-01-14 19:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169160
2019-01-14 19:56:04 [DEBUG   ] info = Starting calibration
2019-01-14 19:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169160  28 58497 71764790 ABOOTINGStarting calibration'
2019-01-14 19:56:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-14 19:56:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-14 19:56:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-14 19:56:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-14 19:56:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-14 19:56:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-14 19:56:05 [INFO    ] Setting Beam 3 xbars
2019-01-14 19:56:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-14 19:56:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-14 19:56:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-14 19:56:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-14 19:56:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-14 19:56:05 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-14 19:56:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-14 19:56:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-14 19:56:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-14 19:56:09 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-14 19:56:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-14 19:56:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-14 19:56:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-14 19:56:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-14 19:56:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-14 19:56:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-14 19:56:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-14 19:56:10 [INFO    ] Setting Beam 4 xbars
2019-01-14 19:56:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-14 19:56:10 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-14 19:56:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-14 19:56:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-14 19:56:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-14 19:56:14 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-14 19:56:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-14 19:56:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-14 19:56:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-14 19:56:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-14 19:56:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-14 19:56:16 [INFO    ] All xbars set
2019-01-14 19:56:16 [INFO    ] Setting adder chain routing for all beams
2019-01-14 19:56:21 [INFO    ] Setting beam ids
2019-01-14 19:56:31 [INFO    ] Starting beam delay calibration
2019-01-14 19:56:43 [INFO    ] Beam 1 latency is 5740
2019-01-14 19:56:43 [INFO    ] Beam 2 latency is 5755
2019-01-14 19:56:43 [INFO    ] Beam 3 latency is 5750
2019-01-14 19:56:43 [INFO    ] Beam 4 latency is 5744
2019-01-14 19:56:43 [INFO    ] Stop calibration
2019-01-14 19:56:51 [INFO    ] Beam delay calibration successful
2019-01-14 19:56:51 [INFO    ] Calibration passed
2019-01-14 19:56:51 [DEBUG   ] spawn_process: at 2019-01-14 19:56:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-14 19:56:51 [DEBUG   ] spawn_process: at 2019-01-14 19:56:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-14 19:56:51 [DEBUG   ] spawn_process: at 2019-01-14 19:56:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-14 19:56:51 [DEBUG   ] spawn_process: at 2019-01-14 19:56:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-14 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-14 19:56:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-14 19:56:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 289 ms (1547495812.292 s) with PID 23856 and time 1547495813
2019-01-14 19:56:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-14 19:56:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 379 ms (1547495812.381 s) with PID 23859 and time 1547495813
2019-01-14 19:56:53 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2019-01-14 19:56:53 [INFO    ] Started antennas statistics background thread
2019-01-14 19:56:53 [INFO    ] Started board flags background thread
2019-01-14 19:56:53 [INFO    ] Started BAM background thread
2019-01-14 19:56:53 [INFO    ] Finished the INI process (ref. #1169150) in 107.932 s
2019-01-14 19:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:56:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:56:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:56:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:56:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:56:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:56:54 [DEBUG   ] Finished updating board flags in 1.064 seconds
2019-01-14 19:57:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:57:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:57:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:57:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:57:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:57:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:57:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:57:54 [WARNING ] (13, 1, 'bot')
2019-01-14 19:57:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:57:54 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-01-14 19:58:05 [DEBUG   ] Got command RPT from MCS: ref #1169180
2019-01-14 19:58:05 [DEBUG   ] summary = ERROR
2019-01-14 19:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169180  13 58497 71885569 A  ERRORERROR'
2019-01-14 19:58:05 [DEBUG   ] Got command RPT from MCS: ref #1169181
2019-01-14 19:58:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 19:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169181  77 58497 71885570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 19:58:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:58:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:58:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:58:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:58:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:58:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:58:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:58:55 [DEBUG   ] Finished updating board flags in 1.849 seconds
2019-01-14 19:59:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 19:59:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:59:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 19:59:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 19:59:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:59:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:59:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:59:55 [WARNING ] (13, 1, 'bot')
2019-01-14 19:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 19:59:55 [DEBUG   ] Finished updating board flags in 1.842 seconds
2019-01-14 20:00:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 20:00:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 20:00:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:00:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:00:54 [WARNING ] (13, 1, 'bot')
2019-01-14 20:00:54 [WARNING ] (13, 1, 'bot')
2019-01-14 20:00:54 [WARNING ] (13, 1, 'bot')
2019-01-14 20:00:54 [WARNING ] (13, 1, 'bot')
2019-01-14 20:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:00:54 [DEBUG   ] Finished updating board flags in 1.154 seconds
2019-01-14 20:01:03 [DEBUG   ] Got command RPT from MCS: ref #1169186
2019-01-14 20:01:03 [DEBUG   ] summary = ERROR
2019-01-14 20:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169186  13 58497 72063253 A  ERRORERROR'
2019-01-14 20:01:03 [DEBUG   ] Got command RPT from MCS: ref #1169187
2019-01-14 20:01:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169187  77 58497 72063457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:01:03 [DEBUG   ] Got command RPT from MCS: ref #1169188
2019-01-14 20:01:03 [DEBUG   ] summary = ERROR
2019-01-14 20:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169188  13 58497 72063661 A  ERRORERROR'
2019-01-14 20:01:03 [DEBUG   ] Got command RPT from MCS: ref #1169189
2019-01-14 20:01:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169189  77 58497 72063853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169190
2019-01-14 20:01:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169190  12 58497 72064057 A  ERRORB™™š'
2019-01-14 20:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169191
2019-01-14 20:01:04 [DEBUG   ] summary = ERROR
2019-01-14 20:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169191  13 58497 72064789 A  ERRORERROR'
2019-01-14 20:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169192
2019-01-14 20:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169192  77 58497 72064790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:01:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:01:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:01:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:01:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:01:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:01:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:01:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:01:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:01:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:01:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:01:55 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-14 20:02:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:02:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:02:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 20:02:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:02:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:02:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:02:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:02:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:02:55 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-14 20:03:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 20:03:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 20:03:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:03:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 20:03:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:03:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:03:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:03:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:03:55 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-14 20:04:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:04:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 20:04:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 20:04:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:04:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:04:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:04:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:04:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:04:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:04:55 [DEBUG   ] Finished updating board flags in 1.259 seconds
2019-01-14 20:05:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:05:33 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-14 20:05:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:05:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:05:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:05:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:05:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:05:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:05:55 [DEBUG   ] Finished updating board flags in 1.127 seconds
2019-01-14 20:06:03 [DEBUG   ] Got command RPT from MCS: ref #1169218
2019-01-14 20:06:03 [DEBUG   ] summary = ERROR
2019-01-14 20:06:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169218  13 58497 72363333 A  ERRORERROR'
2019-01-14 20:06:03 [DEBUG   ] Got command RPT from MCS: ref #1169219
2019-01-14 20:06:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:06:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169219  77 58497 72363537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:06:03 [DEBUG   ] Got command RPT from MCS: ref #1169220
2019-01-14 20:06:03 [DEBUG   ] summary = ERROR
2019-01-14 20:06:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169220  13 58497 72363741 A  ERRORERROR'
2019-01-14 20:06:03 [DEBUG   ] Got command RPT from MCS: ref #1169222
2019-01-14 20:06:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:06:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169222  77 58497 72363945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169223
2019-01-14 20:06:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169223  12 58497 72364137 A  ERRORB˜™š'
2019-01-14 20:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169228
2019-01-14 20:06:04 [DEBUG   ] summary = ERROR
2019-01-14 20:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169228  13 58497 72364797 A  ERRORERROR'
2019-01-14 20:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169229
2019-01-14 20:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169229  77 58497 72364798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:06:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:06:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:06:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:06:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:06:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:06:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:06:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:06:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:06:55 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-01-14 20:07:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:07:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:07:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:07:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 20:07:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:07:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:07:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:07:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:07:55 [DEBUG   ] Finished updating board flags in 0.984 seconds
2019-01-14 20:08:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:08:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:08:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:08:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:08:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:08:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:08:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:08:56 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-14 20:09:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:09:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:09:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:09:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:09:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:09:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:09:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:09:55 [DEBUG   ] Finished updating board flags in 1.260 seconds
2019-01-14 20:10:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:10:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:10:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:10:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:10:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:10:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:10:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:10:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:10:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:10:56 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-14 20:11:03 [DEBUG   ] Got command RPT from MCS: ref #1169249
2019-01-14 20:11:03 [DEBUG   ] summary = ERROR
2019-01-14 20:11:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169249  13 58497 72663421 A  ERRORERROR'
2019-01-14 20:11:03 [DEBUG   ] Got command RPT from MCS: ref #1169250
2019-01-14 20:11:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:11:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169250  77 58497 72663625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:11:03 [DEBUG   ] Got command RPT from MCS: ref #1169251
2019-01-14 20:11:03 [DEBUG   ] summary = ERROR
2019-01-14 20:11:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169251  13 58497 72663829 A  ERRORERROR'
2019-01-14 20:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169252
2019-01-14 20:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169252  77 58497 72664033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169253
2019-01-14 20:11:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169253  12 58497 72664225 A  ERRORB˜™š'
2019-01-14 20:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169254
2019-01-14 20:11:04 [DEBUG   ] summary = ERROR
2019-01-14 20:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169254  13 58497 72664801 A  ERRORERROR'
2019-01-14 20:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169255
2019-01-14 20:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169255  77 58497 72664802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:11:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:11:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:11:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:11:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:11:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:11:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:11:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:11:55 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-01-14 20:12:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:12:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:12:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:12:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:12:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:12:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:12:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:12:55 [WARNING ] (13, 1, 'bot')
2019-01-14 20:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:12:55 [DEBUG   ] Finished updating board flags in 1.039 seconds
2019-01-14 20:13:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:13:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:13:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-14 20:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:13:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:13:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:13:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:13:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:13:56 [DEBUG   ] Finished updating board flags in 1.539 seconds
2019-01-14 20:14:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:14:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:14:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:14:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:14:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:14:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:14:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:14:56 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-01-14 20:15:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:15:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:15:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:15:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:15:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:15:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:15:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:15:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:15:56 [DEBUG   ] Finished updating board flags in 1.243 seconds
2019-01-14 20:15:58 [DEBUG   ] Got command DRX from MCS: ref #1169286
2019-01-14 20:15:58 [INFO    ] sending drx command to lwa34
2019-01-14 20:15:58 [DEBUG   ] run_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35000000.0 6 9 0']
2019-01-14 20:15:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-14 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1169286   8 58497 72958009 A  ERROR'
2019-01-14 20:15:58 [DEBUG   ] Got command DRX from MCS: ref #1169285
2019-01-14 20:15:58 [INFO    ] sending drx command to lwa16
2019-01-14 20:15:58 [DEBUG   ] run_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35000000.0 6 9 0']
2019-01-14 20:15:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-14 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1169285   8 58497 72958013 A  ERROR'
2019-01-14 20:15:58 [DEBUG   ] Got command DRX from MCS: ref #1169287
2019-01-14 20:15:58 [INFO    ] sending drx command to lwa16
2019-01-14 20:15:58 [DEBUG   ] run_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 75000000.0 6 9 0']
2019-01-14 20:15:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-14 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1169287   8 58497 72958017 A  ERROR'
2019-01-14 20:15:58 [DEBUG   ] Got command DRX from MCS: ref #1169288
2019-01-14 20:15:58 [INFO    ] sending drx command to lwa34
2019-01-14 20:15:58 [DEBUG   ] run_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 75000000.0 6 9 0']
2019-01-14 20:15:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-14 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1169288   8 58497 72958021 A  ERROR'
2019-01-14 20:15:58 [DEBUG   ] Got command BAM from MCS: ref #1169290
2019-01-14 20:15:58 [INFO    ] Finished processing BAM request
2019-01-14 20:15:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169290   8 58497 72958025 A  ERROR'
2019-01-14 20:15:58 [DEBUG   ] Got command BAM from MCS: ref #1169289
2019-01-14 20:15:58 [INFO    ] Finished processing BAM request
2019-01-14 20:15:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169289   8 58497 72958029 A  ERROR'
2019-01-14 20:15:58 [INFO    ] Finished starting DRX
2019-01-14 20:15:58 [INFO    ] Finished starting DRX
2019-01-14 20:15:58 [INFO    ] Finished starting DRX
2019-01-14 20:15:58 [INFO    ] Finished starting DRX
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:15:58 [DEBUG   ] spawn_process: at 2019-01-14 20:15:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:16:03 [DEBUG   ] Got command RPT from MCS: ref #1169293
2019-01-14 20:16:03 [DEBUG   ] summary = ERROR
2019-01-14 20:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169293  13 58497 72963501 A  ERRORERROR'
2019-01-14 20:16:03 [DEBUG   ] Got command RPT from MCS: ref #1169294
2019-01-14 20:16:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169294  77 58497 72963705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:16:03 [DEBUG   ] Got command RPT from MCS: ref #1169295
2019-01-14 20:16:03 [DEBUG   ] summary = ERROR
2019-01-14 20:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169295  13 58497 72963909 A  ERRORERROR'
2019-01-14 20:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169296
2019-01-14 20:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169296  77 58497 72964113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169298
2019-01-14 20:16:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169298  12 58497 72964305 A  ERRORB˜™š'
2019-01-14 20:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169302
2019-01-14 20:16:04 [DEBUG   ] summary = ERROR
2019-01-14 20:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169302  13 58497 72964797 A  ERRORERROR'
2019-01-14 20:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169303
2019-01-14 20:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169303  77 58497 72964798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:16:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:16:18 [DEBUG   ] Got command BAM from MCS: ref #1169320
2019-01-14 20:16:18 [INFO    ] Finished processing BAM request
2019-01-14 20:16:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:16:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169320   8 58497 72978033 A  ERROR'
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:16:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:16:18 [DEBUG   ] spawn_process: at 2019-01-14 20:16:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:16:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:16:39 [DEBUG   ] Got command BAM from MCS: ref #1169321
2019-01-14 20:16:39 [INFO    ] Finished processing BAM request
2019-01-14 20:16:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169321   8 58497 72999033 A  ERROR'
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:16:39 [DEBUG   ] spawn_process: at 2019-01-14 20:16:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:16:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 20:16:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:16:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:16:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:16:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:16:56 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-01-14 20:17:00 [DEBUG   ] Got command BAM from MCS: ref #1169322
2019-01-14 20:17:00 [INFO    ] Finished processing BAM request
2019-01-14 20:17:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169322   8 58497 73020029 A  ERROR'
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:17:00 [DEBUG   ] spawn_process: at 2019-01-14 20:17:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:17:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 20:17:21 [DEBUG   ] Got command BAM from MCS: ref #1169327
2019-01-14 20:17:21 [INFO    ] Finished processing BAM request
2019-01-14 20:17:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169327   8 58497 73041029 A  ERROR'
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:17:21 [DEBUG   ] spawn_process: at 2019-01-14 20:17:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:17:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 20:17:41 [DEBUG   ] Got command BAM from MCS: ref #1169328
2019-01-14 20:17:41 [INFO    ] Finished processing BAM request
2019-01-14 20:17:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169328   8 58497 73061033 A  ERROR'
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:17:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:17:41 [DEBUG   ] spawn_process: at 2019-01-14 20:17:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:17:42 [DEBUG   ] Got command BAM from MCS: ref #1169329
2019-01-14 20:17:42 [INFO    ] Finished processing BAM request
2019-01-14 20:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169329   8 58497 73062033 A  ERROR'
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:17:42 [DEBUG   ] spawn_process: at 2019-01-14 20:17:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:17:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 20:17:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 20:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:17:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:17:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:17:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:17:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:17:56 [DEBUG   ] Finished updating board flags in 1.126 seconds
2019-01-14 20:18:04 [DEBUG   ] Got command BAM from MCS: ref #1169330
2019-01-14 20:18:04 [INFO    ] Finished processing BAM request
2019-01-14 20:18:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169330   8 58497 73084033 A  ERROR'
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:18:04 [DEBUG   ] spawn_process: at 2019-01-14 20:18:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:18:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:18:26 [DEBUG   ] Got command BAM from MCS: ref #1169331
2019-01-14 20:18:26 [INFO    ] Finished processing BAM request
2019-01-14 20:18:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169331   8 58497 73106029 A  ERROR'
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:18:26 [DEBUG   ] spawn_process: at 2019-01-14 20:18:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:18:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:18:48 [DEBUG   ] Got command BAM from MCS: ref #1169332
2019-01-14 20:18:48 [INFO    ] Finished processing BAM request
2019-01-14 20:18:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169332   8 58497 73128029 A  ERROR'
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:18:48 [DEBUG   ] spawn_process: at 2019-01-14 20:18:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:18:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:18:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-14 20:18:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-14 20:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:18:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:18:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:18:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:18:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:18:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:18:56 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-14 20:19:10 [DEBUG   ] Got command BAM from MCS: ref #1169333
2019-01-14 20:19:10 [INFO    ] Finished processing BAM request
2019-01-14 20:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169333   8 58497 73150025 A  ERROR'
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:19:10 [DEBUG   ] spawn_process: at 2019-01-14 20:19:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:19:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:19:24 [DEBUG   ] Got command BAM from MCS: ref #1169334
2019-01-14 20:19:24 [INFO    ] Finished processing BAM request
2019-01-14 20:19:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:19:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169334   8 58497 73164029 A  ERROR'
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:19:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:19:24 [DEBUG   ] spawn_process: at 2019-01-14 20:19:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:19:33 [DEBUG   ] Got command BAM from MCS: ref #1169335
2019-01-14 20:19:33 [INFO    ] Finished processing BAM request
2019-01-14 20:19:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169335   8 58497 73173033 A  ERROR'
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:19:33 [DEBUG   ] spawn_process: at 2019-01-14 20:19:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:19:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:19:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:19:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:19:56 [DEBUG   ] Got command BAM from MCS: ref #1169336
2019-01-14 20:19:56 [INFO    ] Finished processing BAM request
2019-01-14 20:19:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169336   8 58497 73196025 A  ERROR'
2019-01-14 20:19:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:19:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 20:19:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:19:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:19:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:19:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:19:56 [DEBUG   ] Finished updating board flags in 1.002 seconds
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:19:56 [DEBUG   ] spawn_process: at 2019-01-14 20:19:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:20:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:20:19 [DEBUG   ] Got command BAM from MCS: ref #1169341
2019-01-14 20:20:19 [INFO    ] Finished processing BAM request
2019-01-14 20:20:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169341   8 58497 73219029 A  ERROR'
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:20:19 [DEBUG   ] spawn_process: at 2019-01-14 20:20:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:20:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:20:42 [DEBUG   ] Got command BAM from MCS: ref #1169342
2019-01-14 20:20:42 [INFO    ] Finished processing BAM request
2019-01-14 20:20:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:20:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169342   8 58497 73242033 A  ERROR'
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:20:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:20:42 [DEBUG   ] spawn_process: at 2019-01-14 20:20:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:20:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-14 20:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-14 20:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:20:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:20:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:20:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:20:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:20:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:20:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:20:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:20:56 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-14 20:21:03 [DEBUG   ] Got command RPT from MCS: ref #1169343
2019-01-14 20:21:03 [DEBUG   ] summary = ERROR
2019-01-14 20:21:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169343  13 58497 73263589 A  ERRORERROR'
2019-01-14 20:21:03 [DEBUG   ] Got command RPT from MCS: ref #1169344
2019-01-14 20:21:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:21:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169344  77 58497 73263793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:21:03 [DEBUG   ] Got command RPT from MCS: ref #1169345
2019-01-14 20:21:04 [DEBUG   ] summary = ERROR
2019-01-14 20:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169345  13 58497 73264006 A  ERRORERROR'
2019-01-14 20:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169346
2019-01-14 20:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169346  77 58497 73264197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169347
2019-01-14 20:21:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169347  12 58497 73264389 A  ERRORB¢ff'
2019-01-14 20:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169348
2019-01-14 20:21:04 [DEBUG   ] summary = ERROR
2019-01-14 20:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169348  13 58497 73264797 A  ERRORERROR'
2019-01-14 20:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169349
2019-01-14 20:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169349  77 58497 73264798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:21:06 [DEBUG   ] Got command BAM from MCS: ref #1169365
2019-01-14 20:21:06 [INFO    ] Finished processing BAM request
2019-01-14 20:21:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169365   8 58497 73266025 A  ERROR'
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:21:06 [DEBUG   ] spawn_process: at 2019-01-14 20:21:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:21:08 [DEBUG   ] Got command BAM from MCS: ref #1169366
2019-01-14 20:21:08 [INFO    ] Finished processing BAM request
2019-01-14 20:21:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169366   8 58497 73268033 A  ERROR'
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:21:08 [DEBUG   ] spawn_process: at 2019-01-14 20:21:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:21:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:21:30 [DEBUG   ] Got command BAM from MCS: ref #1169367
2019-01-14 20:21:30 [INFO    ] Finished processing BAM request
2019-01-14 20:21:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169367   8 58497 73290025 A  ERROR'
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:21:30 [DEBUG   ] spawn_process: at 2019-01-14 20:21:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:21:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:21:54 [DEBUG   ] Got command BAM from MCS: ref #1169368
2019-01-14 20:21:54 [INFO    ] Finished processing BAM request
2019-01-14 20:21:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169368   8 58497 73314029 A  ERROR'
2019-01-14 20:21:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:21:54 [DEBUG   ] spawn_process: at 2019-01-14 20:21:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 20:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 20:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 20:21:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:21:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:21:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:21:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:21:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:21:56 [DEBUG   ] Finished updating board flags in 0.982 seconds
2019-01-14 20:22:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 20:22:19 [DEBUG   ] Got command BAM from MCS: ref #1169369
2019-01-14 20:22:19 [INFO    ] Finished processing BAM request
2019-01-14 20:22:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169369   8 58497 73339025 A  ERROR'
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:22:19 [DEBUG   ] spawn_process: at 2019-01-14 20:22:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:22:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:22:44 [DEBUG   ] Got command BAM from MCS: ref #1169370
2019-01-14 20:22:44 [INFO    ] Finished processing BAM request
2019-01-14 20:22:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:22:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169370   8 58497 73364029 A  ERROR'
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:22:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:22:44 [DEBUG   ] spawn_process: at 2019-01-14 20:22:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:22:52 [DEBUG   ] Got command BAM from MCS: ref #1169371
2019-01-14 20:22:52 [INFO    ] Finished processing BAM request
2019-01-14 20:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169371   8 58497 73372025 A  ERROR'
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:22:52 [DEBUG   ] spawn_process: at 2019-01-14 20:22:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:22:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:22:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:22:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:22:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:22:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 20:22:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:22:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:22:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:22:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:22:56 [DEBUG   ] Finished updating board flags in 1.285 seconds
2019-01-14 20:23:09 [DEBUG   ] Got command BAM from MCS: ref #1169372
2019-01-14 20:23:09 [INFO    ] Finished processing BAM request
2019-01-14 20:23:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:23:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169372   8 58497 73389033 A  ERROR'
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:23:09 [DEBUG   ] spawn_process: at 2019-01-14 20:23:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:23:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:23:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:23:35 [DEBUG   ] Got command BAM from MCS: ref #1169377
2019-01-14 20:23:35 [INFO    ] Finished processing BAM request
2019-01-14 20:23:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169377   8 58497 73415033 A  ERROR'
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:23:35 [DEBUG   ] spawn_process: at 2019-01-14 20:23:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:23:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:23:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:23:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 20:23:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:23:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:23:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:23:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:23:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:23:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:23:56 [DEBUG   ] Finished updating board flags in 1.203 seconds
2019-01-14 20:24:01 [DEBUG   ] Got command BAM from MCS: ref #1169378
2019-01-14 20:24:01 [INFO    ] Finished processing BAM request
2019-01-14 20:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169378   8 58497 73441029 A  ERROR'
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:24:01 [DEBUG   ] spawn_process: at 2019-01-14 20:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:24:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:24:27 [DEBUG   ] Got command BAM from MCS: ref #1169379
2019-01-14 20:24:27 [INFO    ] Finished processing BAM request
2019-01-14 20:24:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169379   8 58497 73467025 A  ERROR'
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:24:27 [DEBUG   ] spawn_process: at 2019-01-14 20:24:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:24:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:24:37 [DEBUG   ] Got command BAM from MCS: ref #1169380
2019-01-14 20:24:37 [INFO    ] Finished processing BAM request
2019-01-14 20:24:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:24:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169380   8 58497 73477029 A  ERROR'
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:24:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:24:37 [DEBUG   ] spawn_process: at 2019-01-14 20:24:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:24:54 [DEBUG   ] Got command BAM from MCS: ref #1169381
2019-01-14 20:24:54 [INFO    ] Finished processing BAM request
2019-01-14 20:24:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169381   8 58497 73494033 A  ERROR'
2019-01-14 20:24:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:24:54 [DEBUG   ] spawn_process: at 2019-01-14 20:24:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 20:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 20:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 20:24:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:24:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:24:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:24:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:24:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:24:56 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-01-14 20:25:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:25:21 [DEBUG   ] Got command BAM from MCS: ref #1169382
2019-01-14 20:25:21 [INFO    ] Finished processing BAM request
2019-01-14 20:25:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169382   8 58497 73521033 A  ERROR'
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:25:21 [DEBUG   ] spawn_process: at 2019-01-14 20:25:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:25:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:25:48 [DEBUG   ] Got command BAM from MCS: ref #1169383
2019-01-14 20:25:48 [INFO    ] Finished processing BAM request
2019-01-14 20:25:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169383   8 58497 73548033 A  ERROR'
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:25:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:25:48 [DEBUG   ] spawn_process: at 2019-01-14 20:25:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:25:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-14 20:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 20:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 20:25:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:25:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:25:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:25:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:25:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:25:56 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-01-14 20:26:03 [DEBUG   ] Got command RPT from MCS: ref #1169386
2019-01-14 20:26:03 [DEBUG   ] summary = ERROR
2019-01-14 20:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169386  13 58497 73563677 A  ERRORERROR'
2019-01-14 20:26:03 [DEBUG   ] Got command RPT from MCS: ref #1169387
2019-01-14 20:26:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169387  77 58497 73563881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169388
2019-01-14 20:26:04 [DEBUG   ] summary = ERROR
2019-01-14 20:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169388  13 58497 73564077 A  ERRORERROR'
2019-01-14 20:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169390
2019-01-14 20:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169390  77 58497 73564281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169391
2019-01-14 20:26:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169391  12 58497 73564485 A  ERRORB£ff'
2019-01-14 20:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169394
2019-01-14 20:26:04 [DEBUG   ] summary = ERROR
2019-01-14 20:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169394  13 58497 73564797 A  ERRORERROR'
2019-01-14 20:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169395
2019-01-14 20:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169395  77 58497 73564797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:26:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:26:16 [DEBUG   ] Got command BAM from MCS: ref #1169417
2019-01-14 20:26:16 [INFO    ] Finished processing BAM request
2019-01-14 20:26:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:26:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169417   8 58497 73576033 A  ERROR'
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:26:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:26:16 [DEBUG   ] spawn_process: at 2019-01-14 20:26:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:26:22 [DEBUG   ] Got command BAM from MCS: ref #1169418
2019-01-14 20:26:22 [INFO    ] Finished processing BAM request
2019-01-14 20:26:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169418   8 58497 73582029 A  ERROR'
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:26:22 [DEBUG   ] spawn_process: at 2019-01-14 20:26:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:26:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:26:44 [DEBUG   ] Got command BAM from MCS: ref #1169419
2019-01-14 20:26:44 [INFO    ] Finished processing BAM request
2019-01-14 20:26:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169419   8 58497 73604029 A  ERROR'
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:26:44 [DEBUG   ] spawn_process: at 2019-01-14 20:26:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:26:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 20:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:26:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:26:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:26:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:26:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:26:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:26:56 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-14 20:27:13 [DEBUG   ] Got command BAM from MCS: ref #1169420
2019-01-14 20:27:13 [INFO    ] Finished processing BAM request
2019-01-14 20:27:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169420   8 58497 73633033 A  ERROR'
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:27:13 [DEBUG   ] spawn_process: at 2019-01-14 20:27:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:27:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:27:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:27:42 [DEBUG   ] Got command BAM from MCS: ref #1169421
2019-01-14 20:27:42 [INFO    ] Finished processing BAM request
2019-01-14 20:27:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169421   8 58497 73662025 A  ERROR'
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:27:42 [DEBUG   ] spawn_process: at 2019-01-14 20:27:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:27:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:27:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:27:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:27:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:27:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:27:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:27:56 [WARNING ] (13, 1, 'bot')
2019-01-14 20:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:27:56 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-14 20:28:08 [DEBUG   ] Got command BAM from MCS: ref #1169422
2019-01-14 20:28:08 [INFO    ] Finished processing BAM request
2019-01-14 20:28:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169422   8 58497 73688025 A  ERROR'
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:28:08 [DEBUG   ] spawn_process: at 2019-01-14 20:28:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:28:12 [DEBUG   ] Got command BAM from MCS: ref #1169423
2019-01-14 20:28:12 [INFO    ] Finished processing BAM request
2019-01-14 20:28:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169423   8 58497 73692029 A  ERROR'
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:28:12 [DEBUG   ] spawn_process: at 2019-01-14 20:28:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:28:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:28:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:28:42 [DEBUG   ] Got command BAM from MCS: ref #1169424
2019-01-14 20:28:42 [INFO    ] Finished processing BAM request
2019-01-14 20:28:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169424   8 58497 73722025 A  ERROR'
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:28:42 [DEBUG   ] spawn_process: at 2019-01-14 20:28:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:28:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:28:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:28:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:28:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 20:28:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:28:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:28:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:28:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:28:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:28:57 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-14 20:29:13 [DEBUG   ] Got command BAM from MCS: ref #1169429
2019-01-14 20:29:13 [INFO    ] Finished processing BAM request
2019-01-14 20:29:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169429   8 58497 73753033 A  ERROR'
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:29:13 [DEBUG   ] spawn_process: at 2019-01-14 20:29:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:29:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:29:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:29:44 [DEBUG   ] Got command BAM from MCS: ref #1169430
2019-01-14 20:29:44 [INFO    ] Finished processing BAM request
2019-01-14 20:29:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169430   8 58497 73784033 A  ERROR'
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:29:44 [DEBUG   ] spawn_process: at 2019-01-14 20:29:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:29:54 [DEBUG   ] Got command BAM from MCS: ref #1169431
2019-01-14 20:29:54 [INFO    ] Finished processing BAM request
2019-01-14 20:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169431   8 58497 73794025 A  ERROR'
2019-01-14 20:29:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:29:54 [DEBUG   ] spawn_process: at 2019-01-14 20:29:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:29:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:29:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 20:29:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:29:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:29:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:29:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:29:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:29:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:29:57 [DEBUG   ] Finished updating board flags in 1.330 seconds
2019-01-14 20:30:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:30:16 [DEBUG   ] Got command BAM from MCS: ref #1169432
2019-01-14 20:30:16 [INFO    ] Finished processing BAM request
2019-01-14 20:30:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169432   8 58497 73816025 A  ERROR'
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:30:16 [DEBUG   ] spawn_process: at 2019-01-14 20:30:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:30:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:30:48 [DEBUG   ] Got command BAM from MCS: ref #1169433
2019-01-14 20:30:48 [INFO    ] Finished processing BAM request
2019-01-14 20:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169433   8 58497 73848029 A  ERROR'
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:30:48 [DEBUG   ] spawn_process: at 2019-01-14 20:30:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:30:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:30:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:30:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:30:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:30:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:30:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:30:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:30:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:30:57 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-01-14 20:31:03 [DEBUG   ] Got command RPT from MCS: ref #1169434
2019-01-14 20:31:03 [DEBUG   ] summary = ERROR
2019-01-14 20:31:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169434  13 58497 73863765 A  ERRORERROR'
2019-01-14 20:31:03 [DEBUG   ] Got command RPT from MCS: ref #1169435
2019-01-14 20:31:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:31:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169435  77 58497 73863969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169436
2019-01-14 20:31:04 [DEBUG   ] summary = ERROR
2019-01-14 20:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169436  13 58497 73864161 A  ERRORERROR'
2019-01-14 20:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169437
2019-01-14 20:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169437  77 58497 73864365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169438
2019-01-14 20:31:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169438  12 58497 73864569 A  ERRORB£ff'
2019-01-14 20:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169439
2019-01-14 20:31:04 [DEBUG   ] summary = ERROR
2019-01-14 20:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169439  13 58497 73864797 A  ERRORERROR'
2019-01-14 20:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169440
2019-01-14 20:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169440  77 58497 73864797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:31:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:31:21 [DEBUG   ] Got command BAM from MCS: ref #1169456
2019-01-14 20:31:21 [INFO    ] Finished processing BAM request
2019-01-14 20:31:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169456   8 58497 73881033 A  ERROR'
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:31:21 [DEBUG   ] spawn_process: at 2019-01-14 20:31:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:31:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:31:41 [DEBUG   ] Got command BAM from MCS: ref #1169457
2019-01-14 20:31:41 [INFO    ] Finished processing BAM request
2019-01-14 20:31:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169457   8 58497 73901029 A  ERROR'
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:31:41 [DEBUG   ] spawn_process: at 2019-01-14 20:31:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:31:54 [DEBUG   ] Got command BAM from MCS: ref #1169458
2019-01-14 20:31:54 [INFO    ] Finished processing BAM request
2019-01-14 20:31:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169458   8 58497 73914033 A  ERROR'
2019-01-14 20:31:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:31:54 [DEBUG   ] spawn_process: at 2019-01-14 20:31:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:31:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 20:31:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 20:31:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:31:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:31:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:31:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:31:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:31:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:31:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:31:57 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-14 20:32:14 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-14 20:32:28 [DEBUG   ] Got command BAM from MCS: ref #1169463
2019-01-14 20:32:28 [INFO    ] Finished processing BAM request
2019-01-14 20:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169463   8 58497 73948033 A  ERROR'
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:32:28 [DEBUG   ] spawn_process: at 2019-01-14 20:32:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:32:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:32:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 20:32:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:32:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 20:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:32:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:32:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:32:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:32:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:32:57 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-01-14 20:33:02 [DEBUG   ] Got command BAM from MCS: ref #1169464
2019-01-14 20:33:02 [INFO    ] Finished processing BAM request
2019-01-14 20:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169464   8 58497 73982033 A  ERROR'
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:33:02 [DEBUG   ] spawn_process: at 2019-01-14 20:33:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:33:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:33:28 [DEBUG   ] Got command BAM from MCS: ref #1169465
2019-01-14 20:33:28 [INFO    ] Finished processing BAM request
2019-01-14 20:33:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169465   8 58497 74008029 A  ERROR'
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:33:28 [DEBUG   ] spawn_process: at 2019-01-14 20:33:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:33:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:33:37 [DEBUG   ] Got command BAM from MCS: ref #1169466
2019-01-14 20:33:37 [INFO    ] Finished processing BAM request
2019-01-14 20:33:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169466   8 58497 74017033 A  ERROR'
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:33:37 [DEBUG   ] spawn_process: at 2019-01-14 20:33:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:33:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:33:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:33:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:33:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:33:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:33:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:33:57 [DEBUG   ] Finished updating board flags in 0.999 seconds
2019-01-14 20:34:13 [DEBUG   ] Got command BAM from MCS: ref #1169467
2019-01-14 20:34:13 [INFO    ] Finished processing BAM request
2019-01-14 20:34:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169467   8 58497 74053029 A  ERROR'
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:34:13 [DEBUG   ] spawn_process: at 2019-01-14 20:34:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:34:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 20:34:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 20:34:49 [DEBUG   ] Got command BAM from MCS: ref #1169468
2019-01-14 20:34:49 [INFO    ] Finished processing BAM request
2019-01-14 20:34:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169468   8 58497 74089029 A  ERROR'
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:34:49 [DEBUG   ] spawn_process: at 2019-01-14 20:34:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:34:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:34:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:34:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:34:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:34:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:34:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:34:58 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-14 20:35:13 [DEBUG   ] Got command BAM from MCS: ref #1169473
2019-01-14 20:35:13 [INFO    ] Finished processing BAM request
2019-01-14 20:35:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169473   8 58497 74113025 A  ERROR'
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:35:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:35:13 [DEBUG   ] spawn_process: at 2019-01-14 20:35:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:35:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:35:26 [DEBUG   ] Got command BAM from MCS: ref #1169474
2019-01-14 20:35:26 [INFO    ] Finished processing BAM request
2019-01-14 20:35:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169474   8 58497 74126025 A  ERROR'
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:35:26 [DEBUG   ] spawn_process: at 2019-01-14 20:35:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:35:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:35:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:35:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 20:35:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:35:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:35:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:35:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:35:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:35:57 [DEBUG   ] Finished updating board flags in 1.230 seconds
2019-01-14 20:36:03 [DEBUG   ] Got command RPT from MCS: ref #1169478
2019-01-14 20:36:03 [DEBUG   ] summary = ERROR
2019-01-14 20:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169478  13 58497 74163849 A  ERRORERROR'
2019-01-14 20:36:04 [DEBUG   ] Got command BAM from MCS: ref #1169477
2019-01-14 20:36:04 [INFO    ] Finished processing BAM request
2019-01-14 20:36:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169477   8 58497 74164033 A  ERROR'
2019-01-14 20:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169479
2019-01-14 20:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169479  77 58497 74164045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169480
2019-01-14 20:36:04 [DEBUG   ] summary = ERROR
2019-01-14 20:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169480  13 58497 74164249 A  ERRORERROR'
2019-01-14 20:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169482
2019-01-14 20:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169482  77 58497 74164453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169484
2019-01-14 20:36:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169484  12 58497 74164657 A  ERRORB£ff'
2019-01-14 20:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169485
2019-01-14 20:36:04 [DEBUG   ] summary = ERROR
2019-01-14 20:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169485  13 58497 74164801 A  ERRORERROR'
2019-01-14 20:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169486
2019-01-14 20:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169486  77 58497 74164801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:36:04 [DEBUG   ] spawn_process: at 2019-01-14 20:36:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:36:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:36:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 20:36:42 [DEBUG   ] Got command BAM from MCS: ref #1169505
2019-01-14 20:36:42 [INFO    ] Finished processing BAM request
2019-01-14 20:36:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169505   8 58497 74202029 A  ERROR'
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:36:42 [DEBUG   ] spawn_process: at 2019-01-14 20:36:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:36:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:36:55 [DEBUG   ] Got command BAM from MCS: ref #1169506
2019-01-14 20:36:55 [INFO    ] Finished processing BAM request
2019-01-14 20:36:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169506   8 58497 74215029 A  ERROR'
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:36:55 [DEBUG   ] spawn_process: at 2019-01-14 20:36:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 20:36:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:36:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:36:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:36:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:36:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:36:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:36:57 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-01-14 20:37:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:37:21 [DEBUG   ] Got command BAM from MCS: ref #1169507
2019-01-14 20:37:21 [INFO    ] Finished processing BAM request
2019-01-14 20:37:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169507   8 58497 74241025 A  ERROR'
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:37:21 [DEBUG   ] spawn_process: at 2019-01-14 20:37:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:37:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:37:54 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-14 20:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:37:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:37:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:37:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:37:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:37:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:37:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:37:57 [DEBUG   ] Finished updating board flags in 1.180 seconds
2019-01-14 20:38:01 [DEBUG   ] Got command BAM from MCS: ref #1169508
2019-01-14 20:38:01 [INFO    ] Finished processing BAM request
2019-01-14 20:38:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169508   8 58497 74281029 A  ERROR'
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:38:01 [DEBUG   ] spawn_process: at 2019-01-14 20:38:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:38:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:38:35 [DEBUG   ] Got command BAM from MCS: ref #1169513
2019-01-14 20:38:35 [INFO    ] Finished processing BAM request
2019-01-14 20:38:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169513   8 58497 74315033 A  ERROR'
2019-01-14 20:38:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:38:35 [DEBUG   ] spawn_process: at 2019-01-14 20:38:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:38:42 [DEBUG   ] Got command BAM from MCS: ref #1169514
2019-01-14 20:38:42 [INFO    ] Finished processing BAM request
2019-01-14 20:38:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169514   8 58497 74322033 A  ERROR'
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:38:42 [DEBUG   ] spawn_process: at 2019-01-14 20:38:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:38:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:38:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:38:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 20:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:38:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 20:38:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:38:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:38:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:38:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:38:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:38:57 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-14 20:39:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:39:24 [DEBUG   ] Got command BAM from MCS: ref #1169515
2019-01-14 20:39:24 [INFO    ] Finished processing BAM request
2019-01-14 20:39:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169515   8 58497 74364025 A  ERROR'
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:39:24 [DEBUG   ] spawn_process: at 2019-01-14 20:39:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:39:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:39:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:39:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 20:39:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:39:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:39:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 20:39:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:39:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:39:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:39:57 [WARNING ] (13, 1, 'bot')
2019-01-14 20:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:39:57 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-01-14 20:40:06 [DEBUG   ] Got command BAM from MCS: ref #1169516
2019-01-14 20:40:06 [INFO    ] Finished processing BAM request
2019-01-14 20:40:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169516   8 58497 74406033 A  ERROR'
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:40:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:40:06 [DEBUG   ] spawn_process: at 2019-01-14 20:40:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:40:13 [DEBUG   ] Got command BAM from MCS: ref #1169517
2019-01-14 20:40:13 [INFO    ] Finished processing BAM request
2019-01-14 20:40:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169517   8 58497 74413033 A  ERROR'
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:40:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:40:13 [DEBUG   ] spawn_process: at 2019-01-14 20:40:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:40:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:40:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:40:49 [DEBUG   ] Got command BAM from MCS: ref #1169518
2019-01-14 20:40:49 [INFO    ] Finished processing BAM request
2019-01-14 20:40:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169518   8 58497 74449033 A  ERROR'
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:40:49 [DEBUG   ] spawn_process: at 2019-01-14 20:40:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:40:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:40:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-14 20:40:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 20:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:40:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:40:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:40:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:40:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:40:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:40:58 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-14 20:41:03 [DEBUG   ] Got command RPT from MCS: ref #1169519
2019-01-14 20:41:03 [DEBUG   ] summary = ERROR
2019-01-14 20:41:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169519  13 58497 74463933 A  ERRORERROR'
2019-01-14 20:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169520
2019-01-14 20:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169520  77 58497 74464137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169521
2019-01-14 20:41:04 [DEBUG   ] summary = ERROR
2019-01-14 20:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169521  13 58497 74464341 A  ERRORERROR'
2019-01-14 20:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169522
2019-01-14 20:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169522  77 58497 74464533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169523
2019-01-14 20:41:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169523  12 58497 74464737 A  ERRORB¢ff'
2019-01-14 20:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169524
2019-01-14 20:41:04 [DEBUG   ] summary = ERROR
2019-01-14 20:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169524  13 58497 74464809 A  ERRORERROR'
2019-01-14 20:41:04 [DEBUG   ] Got command RPT from MCS: ref #1169525
2019-01-14 20:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169525  77 58497 74464810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:41:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:41:33 [DEBUG   ] Got command BAM from MCS: ref #1169545
2019-01-14 20:41:33 [INFO    ] Finished processing BAM request
2019-01-14 20:41:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:41:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169545   8 58497 74493025 A  ERROR'
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:41:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:41:33 [DEBUG   ] spawn_process: at 2019-01-14 20:41:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:41:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:41:50 [DEBUG   ] Got command BAM from MCS: ref #1169546
2019-01-14 20:41:50 [INFO    ] Finished processing BAM request
2019-01-14 20:41:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169546   8 58497 74510025 A  ERROR'
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:41:50 [DEBUG   ] spawn_process: at 2019-01-14 20:41:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:41:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:41:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:41:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:41:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:41:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:41:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:41:58 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-01-14 20:42:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:42:18 [DEBUG   ] Got command BAM from MCS: ref #1169547
2019-01-14 20:42:18 [INFO    ] Finished processing BAM request
2019-01-14 20:42:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169547   8 58497 74538029 A  ERROR'
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:42:18 [DEBUG   ] spawn_process: at 2019-01-14 20:42:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:42:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 20:42:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 20:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 20:42:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:42:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:42:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:42:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:42:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:42:58 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-14 20:43:04 [DEBUG   ] Got command BAM from MCS: ref #1169548
2019-01-14 20:43:04 [INFO    ] Finished processing BAM request
2019-01-14 20:43:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:43:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169548   8 58497 74584025 A  ERROR'
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:43:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:43:04 [DEBUG   ] spawn_process: at 2019-01-14 20:43:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:43:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:43:25 [DEBUG   ] Got command BAM from MCS: ref #1169549
2019-01-14 20:43:25 [INFO    ] Finished processing BAM request
2019-01-14 20:43:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169549   8 58497 74605025 A  ERROR'
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:43:25 [DEBUG   ] spawn_process: at 2019-01-14 20:43:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:43:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:43:51 [DEBUG   ] Got command BAM from MCS: ref #1169550
2019-01-14 20:43:51 [INFO    ] Finished processing BAM request
2019-01-14 20:43:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169550   8 58497 74631029 A  ERROR'
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:43:51 [DEBUG   ] spawn_process: at 2019-01-14 20:43:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:43:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 20:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:43:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:43:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:43:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:43:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:43:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:43:58 [DEBUG   ] Finished updating board flags in 1.177 seconds
2019-01-14 20:44:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:44:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:44:40 [DEBUG   ] Got command BAM from MCS: ref #1169555
2019-01-14 20:44:40 [INFO    ] Finished processing BAM request
2019-01-14 20:44:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169555   8 58497 74680025 A  ERROR'
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:44:40 [DEBUG   ] spawn_process: at 2019-01-14 20:44:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:44:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:44:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:44:58 [DEBUG   ] Got command BAM from MCS: ref #1169556
2019-01-14 20:44:58 [INFO    ] Finished processing BAM request
2019-01-14 20:44:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169556   8 58497 74698029 A  ERROR'
2019-01-14 20:44:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 20:44:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:44:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:44:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:44:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:44:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:44:58 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:44:58 [DEBUG   ] spawn_process: at 2019-01-14 20:44:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:45:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:45:30 [DEBUG   ] Got command BAM from MCS: ref #1169557
2019-01-14 20:45:30 [INFO    ] Finished processing BAM request
2019-01-14 20:45:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169557   8 58497 74730025 A  ERROR'
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:45:30 [DEBUG   ] spawn_process: at 2019-01-14 20:45:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:45:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 20:45:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:45:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:45:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:45:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:45:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:45:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:45:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:45:58 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-01-14 20:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169560
2019-01-14 20:46:04 [DEBUG   ] summary = ERROR
2019-01-14 20:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169560  13 58497 74764021 A  ERRORERROR'
2019-01-14 20:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169561
2019-01-14 20:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169561  77 58497 74764225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169562
2019-01-14 20:46:04 [DEBUG   ] summary = ERROR
2019-01-14 20:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169562  13 58497 74764417 A  ERRORERROR'
2019-01-14 20:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169564
2019-01-14 20:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169564  77 58497 74764621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169565
2019-01-14 20:46:04 [DEBUG   ] summary = ERROR
2019-01-14 20:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169565  13 58497 74764801 A  ERRORERROR'
2019-01-14 20:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169566
2019-01-14 20:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169566  77 58497 74764802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:46:04 [DEBUG   ] Got command RPT from MCS: ref #1169582
2019-01-14 20:46:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169582  12 58497 74764825 A  ERRORB¢ff'
2019-01-14 20:46:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 20:46:21 [DEBUG   ] Got command BAM from MCS: ref #1169587
2019-01-14 20:46:21 [INFO    ] Finished processing BAM request
2019-01-14 20:46:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169587   8 58497 74781029 A  ERROR'
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:46:21 [DEBUG   ] spawn_process: at 2019-01-14 20:46:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:46:30 [DEBUG   ] Got command BAM from MCS: ref #1169588
2019-01-14 20:46:30 [INFO    ] Finished processing BAM request
2019-01-14 20:46:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:46:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169588   8 58497 74790033 A  ERROR'
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:46:30 [DEBUG   ] spawn_process: at 2019-01-14 20:46:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:46:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 20:46:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 20:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:46:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:46:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:46:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:46:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:46:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:46:59 [DEBUG   ] Finished updating board flags in 1.840 seconds
2019-01-14 20:47:13 [DEBUG   ] Got command BAM from MCS: ref #1169593
2019-01-14 20:47:13 [INFO    ] Finished processing BAM request
2019-01-14 20:47:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169593   8 58497 74833030 A  ERROR'
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:47:13 [DEBUG   ] spawn_process: at 2019-01-14 20:47:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:47:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 20:47:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:47:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-14 20:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 20:47:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 20:47:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:47:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:47:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:47:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:47:58 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-01-14 20:48:00 [DEBUG   ] Got command BAM from MCS: ref #1169594
2019-01-14 20:48:00 [INFO    ] Finished processing BAM request
2019-01-14 20:48:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169594   8 58497 74880026 A  ERROR'
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:48:00 [DEBUG   ] spawn_process: at 2019-01-14 20:48:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:48:07 [DEBUG   ] Got command BAM from MCS: ref #1169595
2019-01-14 20:48:07 [INFO    ] Finished processing BAM request
2019-01-14 20:48:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169595   8 58497 74887026 A  ERROR'
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:48:07 [DEBUG   ] spawn_process: at 2019-01-14 20:48:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:48:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:48:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:48:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:48:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 20:48:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:48:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:48:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:48:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:48:58 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-14 20:49:02 [DEBUG   ] Got command BAM from MCS: ref #1169596
2019-01-14 20:49:02 [INFO    ] Finished processing BAM request
2019-01-14 20:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169596   8 58497 74942033 A  ERROR'
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:49:02 [DEBUG   ] spawn_process: at 2019-01-14 20:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:49:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:49:29 [DEBUG   ] Got command BAM from MCS: ref #1169597
2019-01-14 20:49:29 [INFO    ] Finished processing BAM request
2019-01-14 20:49:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169597   8 58497 74969037 A  ERROR'
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:49:29 [DEBUG   ] spawn_process: at 2019-01-14 20:49:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:49:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:49:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:49:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:49:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:49:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:49:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:49:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:49:58 [DEBUG   ] Finished updating board flags in 1.057 seconds
2019-01-14 20:49:59 [DEBUG   ] Got command BAM from MCS: ref #1169598
2019-01-14 20:49:59 [INFO    ] Finished processing BAM request
2019-01-14 20:49:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169598   8 58497 74999029 A  ERROR'
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:49:59 [DEBUG   ] spawn_process: at 2019-01-14 20:49:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:50:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 20:50:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:50:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 20:50:56 [DEBUG   ] Got command BAM from MCS: ref #1169603
2019-01-14 20:50:56 [INFO    ] Finished processing BAM request
2019-01-14 20:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169603   8 58497 75056029 A  ERROR'
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 20:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 20:50:56 [DEBUG   ] spawn_process: at 2019-01-14 20:50:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 20:50:58 [DEBUG   ] Got command BAM from MCS: ref #1169604
2019-01-14 20:50:58 [INFO    ] Finished processing BAM request
2019-01-14 20:50:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169604   8 58497 75058029 A  ERROR'
2019-01-14 20:50:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 20:50:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 20:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:50:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-14 20:50:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:50:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:50:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:50:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:50:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:50:58 [WARNING ] (13, 1, 'bot')
2019-01-14 20:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:50:58 [DEBUG   ] Finished updating board flags in 0.938 seconds
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:50:58 [DEBUG   ] spawn_process: at 2019-01-14 20:50:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169605
2019-01-14 20:51:04 [DEBUG   ] summary = ERROR
2019-01-14 20:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169605  13 58497 75064101 A  ERRORERROR'
2019-01-14 20:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169606
2019-01-14 20:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169606  77 58497 75064305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169607
2019-01-14 20:51:04 [DEBUG   ] summary = ERROR
2019-01-14 20:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169607  13 58497 75064509 A  ERRORERROR'
2019-01-14 20:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169608
2019-01-14 20:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169608  77 58497 75064713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169609
2019-01-14 20:51:04 [DEBUG   ] summary = ERROR
2019-01-14 20:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169609  13 58497 75064809 A  ERRORERROR'
2019-01-14 20:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169610
2019-01-14 20:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169610  77 58497 75064810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:51:04 [DEBUG   ] Got command RPT from MCS: ref #1169626
2019-01-14 20:51:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169626  12 58497 75064905 A  ERRORB£ff'
2019-01-14 20:51:15 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-14 20:51:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:51:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 20:51:58 [DEBUG   ] Got command BAM from MCS: ref #1169627
2019-01-14 20:51:58 [INFO    ] Finished processing BAM request
2019-01-14 20:51:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169627   8 58497 75118025 A  ERROR'
2019-01-14 20:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-14 20:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:51:58 [DEBUG   ] spawn_process: at 2019-01-14 20:51:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 20:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 20:51:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:51:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:51:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:51:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:51:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:51:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:51:59 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-14 20:52:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 20:52:22 [DEBUG   ] Got command BAM from MCS: ref #1169628
2019-01-14 20:52:22 [INFO    ] Finished processing BAM request
2019-01-14 20:52:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169628   8 58497 75142033 A  ERROR'
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:52:22 [DEBUG   ] spawn_process: at 2019-01-14 20:52:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:52:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 20:52:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 20:52:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 20:52:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:52:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:52:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:52:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:52:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:52:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:52:59 [DEBUG   ] Finished updating board flags in 1.092 seconds
2019-01-14 20:53:00 [DEBUG   ] Got command BAM from MCS: ref #1169629
2019-01-14 20:53:00 [INFO    ] Finished processing BAM request
2019-01-14 20:53:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169629   8 58497 75180025 A  ERROR'
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:53:00 [DEBUG   ] spawn_process: at 2019-01-14 20:53:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:53:15 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-01-14 20:53:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:53:46 [DEBUG   ] Got command BAM from MCS: ref #1169634
2019-01-14 20:53:46 [INFO    ] Finished processing BAM request
2019-01-14 20:53:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:53:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169634   8 58497 75226033 A  ERROR'
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:53:46 [DEBUG   ] spawn_process: at 2019-01-14 20:53:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:53:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:53:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:53:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 20:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:53:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:53:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:53:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:53:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:53:59 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-14 20:54:04 [DEBUG   ] Got command BAM from MCS: ref #1169635
2019-01-14 20:54:04 [INFO    ] Finished processing BAM request
2019-01-14 20:54:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169635   8 58497 75244029 A  ERROR'
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:54:04 [DEBUG   ] spawn_process: at 2019-01-14 20:54:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:54:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:54:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 20:54:55 [DEBUG   ] Finished updating ant stats in 0.342 seconds
2019-01-14 20:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:54:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:54:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:54:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:54:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:54:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:54:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:54:59 [DEBUG   ] Finished updating board flags in 1.322 seconds
2019-01-14 20:55:09 [DEBUG   ] Got command BAM from MCS: ref #1169636
2019-01-14 20:55:09 [INFO    ] Finished processing BAM request
2019-01-14 20:55:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169636   8 58497 75309025 A  ERROR'
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:55:09 [DEBUG   ] spawn_process: at 2019-01-14 20:55:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:55:10 [DEBUG   ] Got command BAM from MCS: ref #1169637
2019-01-14 20:55:10 [INFO    ] Finished processing BAM request
2019-01-14 20:55:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169637   8 58497 75310029 A  ERROR'
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:55:10 [DEBUG   ] spawn_process: at 2019-01-14 20:55:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:55:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:55:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:55:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 20:55:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 20:55:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 20:55:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:55:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:55:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:55:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:55:59 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-14 20:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169640
2019-01-14 20:56:04 [DEBUG   ] summary = ERROR
2019-01-14 20:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169640  13 58497 75364189 A  ERRORERROR'
2019-01-14 20:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169641
2019-01-14 20:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169641  77 58497 75364393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169642
2019-01-14 20:56:04 [DEBUG   ] summary = ERROR
2019-01-14 20:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169642  13 58497 75364585 A  ERRORERROR'
2019-01-14 20:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169644
2019-01-14 20:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169644  77 58497 75364789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169645
2019-01-14 20:56:04 [DEBUG   ] summary = ERROR
2019-01-14 20:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169645  13 58497 75364801 A  ERRORERROR'
2019-01-14 20:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169646
2019-01-14 20:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 20:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169646  77 58497 75364802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 20:56:04 [DEBUG   ] Got command RPT from MCS: ref #1169663
2019-01-14 20:56:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 20:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169663  12 58497 75364993 A  ERRORB¤ff'
2019-01-14 20:56:16 [DEBUG   ] Got command BAM from MCS: ref #1169671
2019-01-14 20:56:16 [INFO    ] Finished processing BAM request
2019-01-14 20:56:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169671   8 58497 75376025 A  ERROR'
2019-01-14 20:56:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:56:16 [DEBUG   ] spawn_process: at 2019-01-14 20:56:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:56:31 [DEBUG   ] Got command BAM from MCS: ref #1169672
2019-01-14 20:56:31 [INFO    ] Finished processing BAM request
2019-01-14 20:56:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169672   8 58497 75391029 A  ERROR'
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 20:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 20:56:31 [DEBUG   ] spawn_process: at 2019-01-14 20:56:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 20:56:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:56:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 20:56:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 20:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 20:56:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:56:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:56:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:56:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:56:59 [WARNING ] (13, 1, 'bot')
2019-01-14 20:56:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:56:59 [DEBUG   ] Finished updating board flags in 1.212 seconds
2019-01-14 20:57:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:57:22 [DEBUG   ] Got command BAM from MCS: ref #1169673
2019-01-14 20:57:22 [INFO    ] Finished processing BAM request
2019-01-14 20:57:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169673   8 58497 75442033 A  ERROR'
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:57:22 [DEBUG   ] spawn_process: at 2019-01-14 20:57:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:57:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:57:52 [DEBUG   ] Got command BAM from MCS: ref #1169674
2019-01-14 20:57:52 [INFO    ] Finished processing BAM request
2019-01-14 20:57:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:57:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169674   8 58497 75472033 A  ERROR'
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 20:57:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 20:57:52 [DEBUG   ] spawn_process: at 2019-01-14 20:57:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 20:57:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 20:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:58:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:58:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:58:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:58:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:58:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:58:00 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-01-14 20:58:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:58:28 [DEBUG   ] Got command BAM from MCS: ref #1169675
2019-01-14 20:58:28 [INFO    ] Finished processing BAM request
2019-01-14 20:58:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169675   8 58497 75508025 A  ERROR'
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:58:28 [DEBUG   ] spawn_process: at 2019-01-14 20:58:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:58:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:58:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 20:59:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 20:59:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 20:59:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:59:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:59:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:59:00 [WARNING ] (13, 1, 'bot')
2019-01-14 20:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 20:59:00 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-14 20:59:12 [DEBUG   ] Got command BAM from MCS: ref #1169680
2019-01-14 20:59:12 [INFO    ] Finished processing BAM request
2019-01-14 20:59:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169680   8 58497 75552025 A  ERROR'
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 20:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 20:59:12 [DEBUG   ] spawn_process: at 2019-01-14 20:59:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 20:59:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:59:34 [DEBUG   ] Got command BAM from MCS: ref #1169681
2019-01-14 20:59:34 [INFO    ] Finished processing BAM request
2019-01-14 20:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 20:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169681   8 58497 75574029 A  ERROR'
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 20:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 20:59:34 [DEBUG   ] spawn_process: at 2019-01-14 20:59:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 20:59:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 20:59:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 20:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:00:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:00:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:00:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:00:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:00:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:00:00 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-14 21:00:16 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-14 21:00:31 [DEBUG   ] Got command BAM from MCS: ref #1169682
2019-01-14 21:00:31 [INFO    ] Finished processing BAM request
2019-01-14 21:00:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169682   8 58497 75631029 A  ERROR'
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:00:31 [DEBUG   ] spawn_process: at 2019-01-14 21:00:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:00:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:00:40 [DEBUG   ] Got command BAM from MCS: ref #1169683
2019-01-14 21:00:40 [INFO    ] Finished processing BAM request
2019-01-14 21:00:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169683   8 58497 75640029 A  ERROR'
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:00:40 [DEBUG   ] spawn_process: at 2019-01-14 21:00:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:00:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:01:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:01:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:01:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:01:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:01:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:01:00 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-14 21:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169684
2019-01-14 21:01:04 [DEBUG   ] summary = ERROR
2019-01-14 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169684  13 58497 75664273 A  ERRORERROR'
2019-01-14 21:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169685
2019-01-14 21:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169685  77 58497 75664477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169686
2019-01-14 21:01:04 [DEBUG   ] summary = ERROR
2019-01-14 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169686  13 58497 75664681 A  ERRORERROR'
2019-01-14 21:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169687
2019-01-14 21:01:04 [DEBUG   ] summary = ERROR
2019-01-14 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169687  13 58497 75664813 A  ERRORERROR'
2019-01-14 21:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169688
2019-01-14 21:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169688  77 58497 75664814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:01:04 [DEBUG   ] Got command RPT from MCS: ref #1169704
2019-01-14 21:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169704  77 58497 75664873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:01:05 [DEBUG   ] Got command RPT from MCS: ref #1169705
2019-01-14 21:01:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169705  12 58497 75665077 A  ERRORB£ff'
2019-01-14 21:01:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:01:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:01:46 [DEBUG   ] Got command BAM from MCS: ref #1169706
2019-01-14 21:01:46 [INFO    ] Finished processing BAM request
2019-01-14 21:01:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169706   8 58497 75706033 A  ERROR'
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:01:46 [DEBUG   ] spawn_process: at 2019-01-14 21:01:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:01:49 [DEBUG   ] Got command BAM from MCS: ref #1169707
2019-01-14 21:01:49 [INFO    ] Finished processing BAM request
2019-01-14 21:01:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169707   8 58497 75709025 A  ERROR'
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:01:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:01:49 [DEBUG   ] spawn_process: at 2019-01-14 21:01:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:01:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 21:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:02:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 21:02:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:02:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:02:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:02:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:02:00 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-14 21:02:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:02:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:02:52 [DEBUG   ] Got command BAM from MCS: ref #1169712
2019-01-14 21:02:52 [INFO    ] Finished processing BAM request
2019-01-14 21:02:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:02:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169712   8 58497 75772033 A  ERROR'
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:02:52 [DEBUG   ] spawn_process: at 2019-01-14 21:02:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:02:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-14 21:02:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:03:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:03:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:03:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:03:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:03:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:03:00 [DEBUG   ] Finished updating board flags in 1.205 seconds
2019-01-14 21:03:06 [DEBUG   ] Got command BAM from MCS: ref #1169713
2019-01-14 21:03:06 [INFO    ] Finished processing BAM request
2019-01-14 21:03:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169713   8 58497 75786029 A  ERROR'
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:03:06 [DEBUG   ] spawn_process: at 2019-01-14 21:03:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:03:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 21:03:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 21:03:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 21:03:58 [DEBUG   ] Got command BAM from MCS: ref #1169714
2019-01-14 21:03:58 [INFO    ] Finished processing BAM request
2019-01-14 21:03:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169714   8 58497 75838025 A  ERROR'
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:03:58 [DEBUG   ] spawn_process: at 2019-01-14 21:03:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:04:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:04:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:04:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:04:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:04:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:04:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:04:00 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-01-14 21:04:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 21:04:22 [DEBUG   ] Got command BAM from MCS: ref #1169715
2019-01-14 21:04:22 [INFO    ] Finished processing BAM request
2019-01-14 21:04:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169715   8 58497 75862025 A  ERROR'
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:04:22 [DEBUG   ] spawn_process: at 2019-01-14 21:04:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:04:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:04:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:05:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:05:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 21:05:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:05:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:05:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:05:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:05:00 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-14 21:05:03 [DEBUG   ] Got command BAM from MCS: ref #1169716
2019-01-14 21:05:03 [INFO    ] Finished processing BAM request
2019-01-14 21:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169716   8 58497 75903029 A  ERROR'
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:05:03 [DEBUG   ] spawn_process: at 2019-01-14 21:05:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:05:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 21:05:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:05:37 [DEBUG   ] Got command BAM from MCS: ref #1169721
2019-01-14 21:05:37 [INFO    ] Finished processing BAM request
2019-01-14 21:05:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169721   8 58497 75937033 A  ERROR'
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:05:37 [DEBUG   ] spawn_process: at 2019-01-14 21:05:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:05:56 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-14 21:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:06:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:06:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:06:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:06:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:06:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:06:00 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-01-14 21:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169724
2019-01-14 21:06:04 [DEBUG   ] summary = ERROR
2019-01-14 21:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169724  13 58497 75964353 A  ERRORERROR'
2019-01-14 21:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169725
2019-01-14 21:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169725  77 58497 75964557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169726
2019-01-14 21:06:04 [DEBUG   ] summary = ERROR
2019-01-14 21:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169726  13 58497 75964761 A  ERRORERROR'
2019-01-14 21:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169727
2019-01-14 21:06:04 [DEBUG   ] summary = ERROR
2019-01-14 21:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169727  13 58497 75964809 A  ERRORERROR'
2019-01-14 21:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169728
2019-01-14 21:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169728  77 58497 75964810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:06:04 [DEBUG   ] Got command RPT from MCS: ref #1169745
2019-01-14 21:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169745  77 58497 75964978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:06:05 [DEBUG   ] Got command RPT from MCS: ref #1169746
2019-01-14 21:06:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169746  12 58497 75965157 A  ERRORB¢ff'
2019-01-14 21:06:08 [DEBUG   ] Got command BAM from MCS: ref #1169751
2019-01-14 21:06:08 [INFO    ] Finished processing BAM request
2019-01-14 21:06:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169751   8 58497 75968029 A  ERROR'
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:06:08 [DEBUG   ] spawn_process: at 2019-01-14 21:06:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:06:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:06:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:06:51 [DEBUG   ] Got command BAM from MCS: ref #1169752
2019-01-14 21:06:51 [INFO    ] Finished processing BAM request
2019-01-14 21:06:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169752   8 58497 76011029 A  ERROR'
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:06:51 [DEBUG   ] spawn_process: at 2019-01-14 21:06:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:06:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:07:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 21:07:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:07:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:07:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:07:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:07:00 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-01-14 21:07:13 [DEBUG   ] Got command BAM from MCS: ref #1169753
2019-01-14 21:07:13 [INFO    ] Finished processing BAM request
2019-01-14 21:07:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:07:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169753   8 58497 76033033 A  ERROR'
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:07:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:07:13 [DEBUG   ] spawn_process: at 2019-01-14 21:07:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:07:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:07:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:07:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:08:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:08:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:08:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:08:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:08:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:08:01 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-14 21:08:04 [DEBUG   ] Got command BAM from MCS: ref #1169754
2019-01-14 21:08:04 [INFO    ] Finished processing BAM request
2019-01-14 21:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169754   8 58497 76084033 A  ERROR'
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:08:04 [DEBUG   ] spawn_process: at 2019-01-14 21:08:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:08:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 21:08:18 [DEBUG   ] Got command BAM from MCS: ref #1169759
2019-01-14 21:08:18 [INFO    ] Finished processing BAM request
2019-01-14 21:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169759   8 58497 76098033 A  ERROR'
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:08:18 [DEBUG   ] spawn_process: at 2019-01-14 21:08:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:08:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 21:08:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:09:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:09:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:09:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:09:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:09:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:09:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:09:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:09:00 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-01-14 21:09:16 [DEBUG   ] Got command BAM from MCS: ref #1169760
2019-01-14 21:09:16 [INFO    ] Finished processing BAM request
2019-01-14 21:09:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169760   8 58497 76156033 A  ERROR'
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:09:16 [DEBUG   ] spawn_process: at 2019-01-14 21:09:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:09:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 21:09:23 [DEBUG   ] Got command BAM from MCS: ref #1169761
2019-01-14 21:09:23 [INFO    ] Finished processing BAM request
2019-01-14 21:09:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169761   8 58497 76163033 A  ERROR'
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:09:23 [DEBUG   ] spawn_process: at 2019-01-14 21:09:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:09:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 21:09:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 21:10:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:10:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:10:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:10:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:10:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:10:00 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-14 21:10:17 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-14 21:10:27 [DEBUG   ] Got command BAM from MCS: ref #1169762
2019-01-14 21:10:27 [INFO    ] Finished processing BAM request
2019-01-14 21:10:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169762   8 58497 76227029 A  ERROR'
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:10:27 [DEBUG   ] spawn_process: at 2019-01-14 21:10:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:10:28 [DEBUG   ] Got command BAM from MCS: ref #1169763
2019-01-14 21:10:28 [INFO    ] Finished processing BAM request
2019-01-14 21:10:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169763   8 58497 76228029 A  ERROR'
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:10:28 [DEBUG   ] spawn_process: at 2019-01-14 21:10:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:10:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:10:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:11:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 21:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:11:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:11:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:11:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:11:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:11:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:11:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:11:00 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-01-14 21:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169764
2019-01-14 21:11:04 [DEBUG   ] summary = ERROR
2019-01-14 21:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169764  13 58497 76264445 A  ERRORERROR'
2019-01-14 21:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169765
2019-01-14 21:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169765  77 58497 76264637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169766
2019-01-14 21:11:04 [DEBUG   ] summary = ERROR
2019-01-14 21:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169766  13 58497 76264805 A  ERRORERROR'
2019-01-14 21:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169767
2019-01-14 21:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169767  77 58497 76264806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:11:04 [DEBUG   ] Got command RPT from MCS: ref #1169783
2019-01-14 21:11:04 [DEBUG   ] summary = ERROR
2019-01-14 21:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169783  13 58497 76264841 A  ERRORERROR'
2019-01-14 21:11:05 [DEBUG   ] Got command RPT from MCS: ref #1169784
2019-01-14 21:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169784  77 58497 76265045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:11:05 [DEBUG   ] Got command RPT from MCS: ref #1169785
2019-01-14 21:11:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169785  12 58497 76265250 A  ERRORB¢ff'
2019-01-14 21:11:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:11:33 [DEBUG   ] Got command BAM from MCS: ref #1169790
2019-01-14 21:11:33 [INFO    ] Finished processing BAM request
2019-01-14 21:11:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169790   8 58497 76293033 A  ERROR'
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:11:33 [DEBUG   ] spawn_process: at 2019-01-14 21:11:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:11:37 [DEBUG   ] Got command BAM from MCS: ref #1169791
2019-01-14 21:11:37 [INFO    ] Finished processing BAM request
2019-01-14 21:11:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169791   8 58497 76297033 A  ERROR'
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:11:37 [DEBUG   ] spawn_process: at 2019-01-14 21:11:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:11:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 21:11:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:12:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:12:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:12:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:12:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:12:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:12:00 [WARNING ] (13, 1, 'bot')
2019-01-14 21:12:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:12:00 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-01-14 21:12:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:12:38 [DEBUG   ] Got command BAM from MCS: ref #1169792
2019-01-14 21:12:38 [INFO    ] Finished processing BAM request
2019-01-14 21:12:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169792   8 58497 76358033 A  ERROR'
2019-01-14 21:12:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:12:38 [DEBUG   ] spawn_process: at 2019-01-14 21:12:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:12:46 [DEBUG   ] Got command BAM from MCS: ref #1169793
2019-01-14 21:12:46 [INFO    ] Finished processing BAM request
2019-01-14 21:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169793   8 58497 76366029 A  ERROR'
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:12:46 [DEBUG   ] spawn_process: at 2019-01-14 21:12:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:12:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:13:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 21:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:13:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-14 21:13:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:13:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:13:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:13:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:13:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:13:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:13:01 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-01-14 21:13:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:13:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:13:43 [DEBUG   ] Got command BAM from MCS: ref #1169794
2019-01-14 21:13:43 [INFO    ] Finished processing BAM request
2019-01-14 21:13:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169794   8 58497 76423025 A  ERROR'
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:13:43 [DEBUG   ] spawn_process: at 2019-01-14 21:13:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:13:55 [DEBUG   ] Got command BAM from MCS: ref #1169795
2019-01-14 21:13:55 [INFO    ] Finished processing BAM request
2019-01-14 21:13:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169795   8 58497 76435029 A  ERROR'
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:13:55 [DEBUG   ] spawn_process: at 2019-01-14 21:13:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:13:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:14:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:14:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:14:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:14:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:14:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:14:01 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-14 21:14:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:14:38 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2019-01-14 21:14:48 [DEBUG   ] Got command BAM from MCS: ref #1169800
2019-01-14 21:14:48 [INFO    ] Finished processing BAM request
2019-01-14 21:14:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169800   8 58497 76488025 A  ERROR'
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:14:48 [DEBUG   ] spawn_process: at 2019-01-14 21:14:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:14:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 21:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:15:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:15:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:15:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:15:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:15:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:15:01 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-01-14 21:15:03 [DEBUG   ] Got command BAM from MCS: ref #1169801
2019-01-14 21:15:03 [INFO    ] Finished processing BAM request
2019-01-14 21:15:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169801   8 58497 76503029 A  ERROR'
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:15:03 [DEBUG   ] spawn_process: at 2019-01-14 21:15:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:15:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:15:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:15:53 [DEBUG   ] Got command BAM from MCS: ref #1169802
2019-01-14 21:15:53 [INFO    ] Finished processing BAM request
2019-01-14 21:15:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169802   8 58497 76553033 A  ERROR'
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:15:53 [DEBUG   ] spawn_process: at 2019-01-14 21:15:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:15:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:16:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:16:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:16:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:16:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:16:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:16:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:16:01 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-01-14 21:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169805
2019-01-14 21:16:04 [DEBUG   ] summary = ERROR
2019-01-14 21:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169805  13 58497 76564529 A  ERRORERROR'
2019-01-14 21:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169806
2019-01-14 21:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169806  77 58497 76564721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169807
2019-01-14 21:16:04 [DEBUG   ] summary = ERROR
2019-01-14 21:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169807  13 58497 76564817 A  ERRORERROR'
2019-01-14 21:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169808
2019-01-14 21:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169808  77 58497 76564817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:16:04 [DEBUG   ] Got command RPT from MCS: ref #1169824
2019-01-14 21:16:04 [DEBUG   ] summary = ERROR
2019-01-14 21:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169824  13 58497 76564925 A  ERRORERROR'
2019-01-14 21:16:05 [DEBUG   ] Got command RPT from MCS: ref #1169826
2019-01-14 21:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169826  77 58497 76565129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:16:05 [DEBUG   ] Got command RPT from MCS: ref #1169827
2019-01-14 21:16:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169827  12 58497 76565333 A  ERRORB¡ff'
2019-01-14 21:16:10 [DEBUG   ] Got command BAM from MCS: ref #1169832
2019-01-14 21:16:10 [INFO    ] Finished processing BAM request
2019-01-14 21:16:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169832   8 58497 76570029 A  ERROR'
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:16:10 [DEBUG   ] spawn_process: at 2019-01-14 21:16:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:16:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:16:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:16:58 [DEBUG   ] Got command BAM from MCS: ref #1169833
2019-01-14 21:16:58 [INFO    ] Finished processing BAM request
2019-01-14 21:16:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169833   8 58497 76618033 A  ERROR'
2019-01-14 21:16:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:16:58 [DEBUG   ] spawn_process: at 2019-01-14 21:16:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:17:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:17:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:17:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:17:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:17:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:17:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:17:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:17:01 [DEBUG   ] Finished updating board flags in 1.284 seconds
2019-01-14 21:17:17 [DEBUG   ] Got command BAM from MCS: ref #1169838
2019-01-14 21:17:17 [INFO    ] Finished processing BAM request
2019-01-14 21:17:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169838   8 58497 76637029 A  ERROR'
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:17:17 [DEBUG   ] spawn_process: at 2019-01-14 21:17:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:17:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:17:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 21:17:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-14 21:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 21:18:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:18:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:18:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:18:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:18:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:18:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:18:01 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-01-14 21:18:03 [DEBUG   ] Got command BAM from MCS: ref #1169839
2019-01-14 21:18:03 [INFO    ] Finished processing BAM request
2019-01-14 21:18:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:18:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169839   8 58497 76683029 A  ERROR'
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:18:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:18:03 [DEBUG   ] spawn_process: at 2019-01-14 21:18:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:18:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 21:18:23 [DEBUG   ] Got command BAM from MCS: ref #1169840
2019-01-14 21:18:23 [INFO    ] Finished processing BAM request
2019-01-14 21:18:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169840   8 58497 76703025 A  ERROR'
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:18:23 [DEBUG   ] spawn_process: at 2019-01-14 21:18:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:18:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:18:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:19:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:19:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:19:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:19:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:19:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:19:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:19:02 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-01-14 21:19:08 [DEBUG   ] Got command BAM from MCS: ref #1169841
2019-01-14 21:19:08 [INFO    ] Finished processing BAM request
2019-01-14 21:19:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169841   8 58497 76748033 A  ERROR'
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:19:08 [DEBUG   ] spawn_process: at 2019-01-14 21:19:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:19:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:19:28 [DEBUG   ] Got command BAM from MCS: ref #1169842
2019-01-14 21:19:28 [INFO    ] Finished processing BAM request
2019-01-14 21:19:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169842   8 58497 76768029 A  ERROR'
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:19:28 [DEBUG   ] spawn_process: at 2019-01-14 21:19:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:19:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:19:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-14 21:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-14 21:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:20:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:20:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:20:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:20:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:20:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:20:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:20:01 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-01-14 21:20:13 [DEBUG   ] Got command BAM from MCS: ref #1169847
2019-01-14 21:20:13 [INFO    ] Finished processing BAM request
2019-01-14 21:20:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169847   8 58497 76813025 A  ERROR'
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:20:13 [DEBUG   ] spawn_process: at 2019-01-14 21:20:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:20:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:20:33 [DEBUG   ] Got command BAM from MCS: ref #1169848
2019-01-14 21:20:33 [INFO    ] Finished processing BAM request
2019-01-14 21:20:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169848   8 58497 76833033 A  ERROR'
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:20:33 [DEBUG   ] spawn_process: at 2019-01-14 21:20:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:20:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:20:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2019-01-14 21:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-14 21:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 21:21:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:21:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:21:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:21:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:21:01 [WARNING ] (13, 1, 'bot')
2019-01-14 21:21:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:21:01 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-01-14 21:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169849
2019-01-14 21:21:04 [DEBUG   ] summary = ERROR
2019-01-14 21:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169849  13 58497 76864613 A  ERRORERROR'
2019-01-14 21:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169850
2019-01-14 21:21:04 [DEBUG   ] summary = ERROR
2019-01-14 21:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169850  13 58497 76864817 A  ERRORERROR'
2019-01-14 21:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169851
2019-01-14 21:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169851  77 58497 76864818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:21:04 [DEBUG   ] Got command RPT from MCS: ref #1169866
2019-01-14 21:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169866  77 58497 76864818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:21:05 [DEBUG   ] Got command RPT from MCS: ref #1169868
2019-01-14 21:21:05 [DEBUG   ] summary = ERROR
2019-01-14 21:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169868  13 58497 76865009 A  ERRORERROR'
2019-01-14 21:21:05 [DEBUG   ] Got command RPT from MCS: ref #1169869
2019-01-14 21:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169869  77 58497 76865213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:21:05 [DEBUG   ] Got command RPT from MCS: ref #1169870
2019-01-14 21:21:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169870  12 58497 76865417 A  ERRORB£ff'
2019-01-14 21:21:18 [DEBUG   ] Got command BAM from MCS: ref #1169871
2019-01-14 21:21:18 [INFO    ] Finished processing BAM request
2019-01-14 21:21:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169871   8 58497 76878025 A  ERROR'
2019-01-14 21:21:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:21:18 [DEBUG   ] spawn_process: at 2019-01-14 21:21:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:21:37 [DEBUG   ] Got command BAM from MCS: ref #1169872
2019-01-14 21:21:37 [INFO    ] Finished processing BAM request
2019-01-14 21:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169872   8 58497 76897025 A  ERROR'
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:21:37 [DEBUG   ] spawn_process: at 2019-01-14 21:21:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:21:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:21:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 21:22:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:22:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:22:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:22:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:22:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:22:02 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-01-14 21:22:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:22:22 [DEBUG   ] Got command BAM from MCS: ref #1169873
2019-01-14 21:22:22 [INFO    ] Finished processing BAM request
2019-01-14 21:22:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169873   8 58497 76942033 A  ERROR'
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:22:22 [DEBUG   ] spawn_process: at 2019-01-14 21:22:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:22:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:22:40 [DEBUG   ] Got command BAM from MCS: ref #1169874
2019-01-14 21:22:40 [INFO    ] Finished processing BAM request
2019-01-14 21:22:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169874   8 58497 76960033 A  ERROR'
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:22:40 [DEBUG   ] spawn_process: at 2019-01-14 21:22:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:22:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 21:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:23:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 21:23:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:23:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:23:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:23:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:23:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:23:02 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-01-14 21:23:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:23:26 [DEBUG   ] Got command BAM from MCS: ref #1169879
2019-01-14 21:23:26 [INFO    ] Finished processing BAM request
2019-01-14 21:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169879   8 58497 77006029 A  ERROR'
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:23:26 [DEBUG   ] spawn_process: at 2019-01-14 21:23:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:23:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:23:43 [DEBUG   ] Got command BAM from MCS: ref #1169880
2019-01-14 21:23:43 [INFO    ] Finished processing BAM request
2019-01-14 21:23:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169880   8 58497 77023029 A  ERROR'
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:23:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:23:43 [DEBUG   ] spawn_process: at 2019-01-14 21:23:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:23:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:24:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:24:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:24:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:24:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:24:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:24:02 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-14 21:24:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:24:30 [DEBUG   ] Got command BAM from MCS: ref #1169881
2019-01-14 21:24:30 [INFO    ] Finished processing BAM request
2019-01-14 21:24:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169881   8 58497 77070033 A  ERROR'
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:24:30 [DEBUG   ] spawn_process: at 2019-01-14 21:24:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:24:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:24:45 [DEBUG   ] Got command BAM from MCS: ref #1169882
2019-01-14 21:24:45 [INFO    ] Finished processing BAM request
2019-01-14 21:24:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169882   8 58497 77085029 A  ERROR'
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:24:45 [DEBUG   ] spawn_process: at 2019-01-14 21:24:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:24:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:25:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-14 21:25:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 21:25:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:25:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 21:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:25:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:25:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:25:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:25:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:25:02 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-01-14 21:25:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:25:34 [DEBUG   ] Got command BAM from MCS: ref #1169883
2019-01-14 21:25:34 [INFO    ] Finished processing BAM request
2019-01-14 21:25:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:25:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169883   8 58497 77134029 A  ERROR'
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:25:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:25:34 [DEBUG   ] spawn_process: at 2019-01-14 21:25:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:25:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:25:47 [DEBUG   ] Got command BAM from MCS: ref #1169884
2019-01-14 21:25:47 [INFO    ] Finished processing BAM request
2019-01-14 21:25:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:25:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169884   8 58497 77147033 A  ERROR'
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:25:47 [DEBUG   ] spawn_process: at 2019-01-14 21:25:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:25:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:26:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:26:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:26:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:26:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:26:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:26:02 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-01-14 21:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169887
2019-01-14 21:26:04 [DEBUG   ] summary = ERROR
2019-01-14 21:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169887  13 58497 77164693 A  ERRORERROR'
2019-01-14 21:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169888
2019-01-14 21:26:04 [DEBUG   ] summary = ERROR
2019-01-14 21:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169888  13 58497 77164813 A  ERRORERROR'
2019-01-14 21:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169889
2019-01-14 21:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169889  77 58497 77164814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:26:04 [DEBUG   ] Got command RPT from MCS: ref #1169905
2019-01-14 21:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169905  77 58497 77164897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:26:05 [DEBUG   ] Got command RPT from MCS: ref #1169906
2019-01-14 21:26:05 [DEBUG   ] summary = ERROR
2019-01-14 21:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169906  13 58497 77165101 A  ERRORERROR'
2019-01-14 21:26:05 [DEBUG   ] Got command RPT from MCS: ref #1169908
2019-01-14 21:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169908  77 58497 77165305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:26:05 [DEBUG   ] Got command RPT from MCS: ref #1169909
2019-01-14 21:26:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169909  12 58497 77165497 A  ERRORB¤ff'
2019-01-14 21:26:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:26:38 [DEBUG   ] Got command BAM from MCS: ref #1169918
2019-01-14 21:26:38 [INFO    ] Finished processing BAM request
2019-01-14 21:26:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169918   8 58497 77198033 A  ERROR'
2019-01-14 21:26:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:26:38 [DEBUG   ] spawn_process: at 2019-01-14 21:26:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:26:48 [DEBUG   ] Got command BAM from MCS: ref #1169919
2019-01-14 21:26:48 [INFO    ] Finished processing BAM request
2019-01-14 21:26:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169919   8 58497 77208033 A  ERROR'
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:26:48 [DEBUG   ] spawn_process: at 2019-01-14 21:26:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:26:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:27:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:27:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:27:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:27:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:27:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:27:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:27:02 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-14 21:27:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:27:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:27:42 [DEBUG   ] Got command BAM from MCS: ref #1169920
2019-01-14 21:27:42 [INFO    ] Finished processing BAM request
2019-01-14 21:27:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169920   8 58497 77262029 A  ERROR'
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:27:42 [DEBUG   ] spawn_process: at 2019-01-14 21:27:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:27:49 [DEBUG   ] Got command BAM from MCS: ref #1169921
2019-01-14 21:27:49 [INFO    ] Finished processing BAM request
2019-01-14 21:27:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:27:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169921   8 58497 77269025 A  ERROR'
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:27:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:27:49 [DEBUG   ] spawn_process: at 2019-01-14 21:27:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:27:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:28:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:28:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-14 21:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 21:28:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:28:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:28:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:28:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:28:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:28:02 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-14 21:28:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 21:28:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:28:46 [DEBUG   ] Got command BAM from MCS: ref #1169922
2019-01-14 21:28:46 [INFO    ] Finished processing BAM request
2019-01-14 21:28:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169922   8 58497 77326025 A  ERROR'
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:28:46 [DEBUG   ] spawn_process: at 2019-01-14 21:28:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:28:49 [DEBUG   ] Got command BAM from MCS: ref #1169923
2019-01-14 21:28:49 [INFO    ] Finished processing BAM request
2019-01-14 21:28:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169923   8 58497 77329029 A  ERROR'
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:28:49 [DEBUG   ] spawn_process: at 2019-01-14 21:28:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:28:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:29:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:29:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:29:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:29:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:29:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:29:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:29:02 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-01-14 21:29:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 21:29:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:29:49 [DEBUG   ] Got command BAM from MCS: ref #1169928
2019-01-14 21:29:49 [INFO    ] Finished processing BAM request
2019-01-14 21:29:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169928   8 58497 77389025 A  ERROR'
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:29:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:29:49 [DEBUG   ] spawn_process: at 2019-01-14 21:29:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:29:50 [DEBUG   ] Got command BAM from MCS: ref #1169929
2019-01-14 21:29:50 [INFO    ] Finished processing BAM request
2019-01-14 21:29:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169929   8 58497 77390025 A  ERROR'
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:29:50 [DEBUG   ] spawn_process: at 2019-01-14 21:29:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:29:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:30:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:30:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:30:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:30:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:30:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:30:02 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-14 21:30:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:30:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 21:30:48 [DEBUG   ] Got command BAM from MCS: ref #1169930
2019-01-14 21:30:48 [INFO    ] Finished processing BAM request
2019-01-14 21:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169930   8 58497 77448025 A  ERROR'
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:30:48 [DEBUG   ] spawn_process: at 2019-01-14 21:30:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:30:54 [DEBUG   ] Got command BAM from MCS: ref #1169931
2019-01-14 21:30:54 [INFO    ] Finished processing BAM request
2019-01-14 21:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169931   8 58497 77454029 A  ERROR'
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:30:54 [DEBUG   ] spawn_process: at 2019-01-14 21:30:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:30:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:31:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 21:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 21:31:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:31:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:31:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:31:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:31:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:31:02 [DEBUG   ] Finished updating board flags in 1.277 seconds
2019-01-14 21:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169932
2019-01-14 21:31:04 [DEBUG   ] summary = ERROR
2019-01-14 21:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169932  13 58497 77464785 A  ERRORERROR'
2019-01-14 21:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169933
2019-01-14 21:31:04 [DEBUG   ] summary = ERROR
2019-01-14 21:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169933  13 58497 77464809 A  ERRORERROR'
2019-01-14 21:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169934
2019-01-14 21:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169934  77 58497 77464810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:31:04 [DEBUG   ] Got command RPT from MCS: ref #1169950
2019-01-14 21:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169950  77 58497 77464981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:31:05 [DEBUG   ] Got command RPT from MCS: ref #1169951
2019-01-14 21:31:05 [DEBUG   ] summary = ERROR
2019-01-14 21:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169951  13 58497 77465185 A  ERRORERROR'
2019-01-14 21:31:05 [DEBUG   ] Got command RPT from MCS: ref #1169952
2019-01-14 21:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169952  77 58497 77465389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:31:05 [DEBUG   ] Got command RPT from MCS: ref #1169953
2019-01-14 21:31:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169953  12 58497 77465593 A  ERRORB£ff'
2019-01-14 21:31:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:31:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:31:47 [DEBUG   ] Got command BAM from MCS: ref #1169954
2019-01-14 21:31:47 [INFO    ] Finished processing BAM request
2019-01-14 21:31:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169954   8 58497 77507033 A  ERROR'
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:31:47 [DEBUG   ] spawn_process: at 2019-01-14 21:31:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:31:58 [DEBUG   ] Got command BAM from MCS: ref #1169955
2019-01-14 21:31:58 [INFO    ] Finished processing BAM request
2019-01-14 21:31:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169955   8 58497 77518029 A  ERROR'
2019-01-14 21:31:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:31:58 [DEBUG   ] spawn_process: at 2019-01-14 21:31:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:32:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:32:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:32:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:32:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:32:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:32:02 [WARNING ] (13, 1, 'bot')
2019-01-14 21:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:32:02 [DEBUG   ] Finished updating board flags in 1.166 seconds
2019-01-14 21:32:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:32:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:32:45 [DEBUG   ] Got command BAM from MCS: ref #1169960
2019-01-14 21:32:45 [INFO    ] Finished processing BAM request
2019-01-14 21:32:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:32:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169960   8 58497 77565025 A  ERROR'
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:32:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:32:45 [DEBUG   ] spawn_process: at 2019-01-14 21:32:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:32:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:33:02 [DEBUG   ] Got command BAM from MCS: ref #1169961
2019-01-14 21:33:02 [INFO    ] Finished processing BAM request
2019-01-14 21:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169961   8 58497 77582033 A  ERROR'
2019-01-14 21:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:33:02 [DEBUG   ] spawn_process: at 2019-01-14 21:33:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:33:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:33:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:33:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:33:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:33:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:33:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:33:03 [DEBUG   ] Finished updating board flags in 1.556 seconds
2019-01-14 21:33:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:33:38 [DEBUG   ] Finished updating ant stats in 0.390 seconds
2019-01-14 21:33:43 [DEBUG   ] Got command BAM from MCS: ref #1169962
2019-01-14 21:33:43 [INFO    ] Finished processing BAM request
2019-01-14 21:33:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169962   8 58497 77623033 A  ERROR'
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:33:43 [DEBUG   ] spawn_process: at 2019-01-14 21:33:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:33:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 21:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:34:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:34:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:34:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:34:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:34:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:34:03 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-01-14 21:34:06 [DEBUG   ] Got command BAM from MCS: ref #1169963
2019-01-14 21:34:06 [INFO    ] Finished processing BAM request
2019-01-14 21:34:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169963   8 58497 77646033 A  ERROR'
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:34:06 [DEBUG   ] spawn_process: at 2019-01-14 21:34:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:34:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:34:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:34:40 [DEBUG   ] Got command BAM from MCS: ref #1169964
2019-01-14 21:34:40 [INFO    ] Finished processing BAM request
2019-01-14 21:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169964   8 58497 77680029 A  ERROR'
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:34:40 [DEBUG   ] spawn_process: at 2019-01-14 21:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:34:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:35:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:35:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 21:35:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:35:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:35:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:35:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:35:03 [DEBUG   ] Finished updating board flags in 1.339 seconds
2019-01-14 21:35:10 [DEBUG   ] Got command BAM from MCS: ref #1169965
2019-01-14 21:35:10 [INFO    ] Finished processing BAM request
2019-01-14 21:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169965   8 58497 77710025 A  ERROR'
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:35:10 [DEBUG   ] spawn_process: at 2019-01-14 21:35:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:35:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:35:37 [DEBUG   ] Got command BAM from MCS: ref #1169970
2019-01-14 21:35:37 [INFO    ] Finished processing BAM request
2019-01-14 21:35:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1169970   8 58497 77737029 A  ERROR'
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:35:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:35:37 [DEBUG   ] spawn_process: at 2019-01-14 21:35:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:35:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:35:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:36:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 21:36:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 21:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:36:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:36:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:36:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:36:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:36:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:36:03 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-14 21:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169973
2019-01-14 21:36:04 [DEBUG   ] summary = ERROR
2019-01-14 21:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169973  13 58497 77764821 A  ERRORERROR'
2019-01-14 21:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169974
2019-01-14 21:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169974  77 58497 77764822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:36:04 [DEBUG   ] Got command RPT from MCS: ref #1169990
2019-01-14 21:36:04 [DEBUG   ] summary = ERROR
2019-01-14 21:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169990  13 58497 77764869 A  ERRORERROR'
2019-01-14 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1169991
2019-01-14 21:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169991  77 58497 77765073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1169992
2019-01-14 21:36:05 [DEBUG   ] summary = ERROR
2019-01-14 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169992  13 58497 77765265 A  ERRORERROR'
2019-01-14 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1169994
2019-01-14 21:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169994  77 58497 77765469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1169995
2019-01-14 21:36:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1169995  12 58497 77765673 A  ERRORB¢ff'
2019-01-14 21:36:14 [DEBUG   ] Got command BAM from MCS: ref #1170000
2019-01-14 21:36:14 [INFO    ] Finished processing BAM request
2019-01-14 21:36:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:36:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170000   8 58497 77774029 A  ERROR'
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:36:14 [DEBUG   ] spawn_process: at 2019-01-14 21:36:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:36:19 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2019-01-14 21:36:33 [DEBUG   ] Got command BAM from MCS: ref #1170001
2019-01-14 21:36:33 [INFO    ] Finished processing BAM request
2019-01-14 21:36:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170001   8 58497 77793029 A  ERROR'
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:36:33 [DEBUG   ] spawn_process: at 2019-01-14 21:36:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:36:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:36:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:37:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:37:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:37:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:37:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:37:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:37:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:37:03 [DEBUG   ] Finished updating board flags in 1.186 seconds
2019-01-14 21:37:18 [DEBUG   ] Got command BAM from MCS: ref #1170002
2019-01-14 21:37:18 [INFO    ] Finished processing BAM request
2019-01-14 21:37:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170002   8 58497 77838025 A  ERROR'
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:37:18 [DEBUG   ] spawn_process: at 2019-01-14 21:37:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:37:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:37:29 [DEBUG   ] Got command BAM from MCS: ref #1170003
2019-01-14 21:37:29 [INFO    ] Finished processing BAM request
2019-01-14 21:37:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170003   8 58497 77849029 A  ERROR'
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:37:29 [DEBUG   ] spawn_process: at 2019-01-14 21:37:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:37:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:37:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:38:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:38:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:38:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:38:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:38:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:38:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:38:03 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-01-14 21:38:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:38:22 [DEBUG   ] Got command BAM from MCS: ref #1170008
2019-01-14 21:38:22 [INFO    ] Finished processing BAM request
2019-01-14 21:38:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170008   8 58497 77902029 A  ERROR'
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:38:22 [DEBUG   ] spawn_process: at 2019-01-14 21:38:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:38:24 [DEBUG   ] Got command BAM from MCS: ref #1170009
2019-01-14 21:38:24 [INFO    ] Finished processing BAM request
2019-01-14 21:38:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170009   8 58497 77904025 A  ERROR'
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:38:24 [DEBUG   ] spawn_process: at 2019-01-14 21:38:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:38:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:38:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:39:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:39:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:39:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:39:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:39:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:39:03 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-14 21:39:19 [DEBUG   ] Got command BAM from MCS: ref #1170010
2019-01-14 21:39:19 [INFO    ] Finished processing BAM request
2019-01-14 21:39:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170010   8 58497 77959033 A  ERROR'
2019-01-14 21:39:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:39:19 [DEBUG   ] spawn_process: at 2019-01-14 21:39:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:39:26 [DEBUG   ] Got command BAM from MCS: ref #1170011
2019-01-14 21:39:26 [INFO    ] Finished processing BAM request
2019-01-14 21:39:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170011   8 58497 77966025 A  ERROR'
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:39:26 [DEBUG   ] spawn_process: at 2019-01-14 21:39:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:39:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 21:39:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 21:40:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 21:40:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:40:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:40:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:40:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:40:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:40:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:40:03 [DEBUG   ] Finished updating board flags in 0.988 seconds
2019-01-14 21:40:14 [DEBUG   ] Got command BAM from MCS: ref #1170012
2019-01-14 21:40:14 [INFO    ] Finished processing BAM request
2019-01-14 21:40:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170012   8 58497 78014041 A  ERROR'
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:40:14 [DEBUG   ] spawn_process: at 2019-01-14 21:40:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:40:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:40:30 [DEBUG   ] Got command BAM from MCS: ref #1170013
2019-01-14 21:40:30 [INFO    ] Finished processing BAM request
2019-01-14 21:40:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170013   8 58497 78030033 A  ERROR'
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:40:30 [DEBUG   ] spawn_process: at 2019-01-14 21:40:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:40:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:40:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 21:41:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:41:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:41:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:41:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:41:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:41:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:41:03 [DEBUG   ] Finished updating board flags in 1.279 seconds
2019-01-14 21:41:04 [DEBUG   ] Got command RPT from MCS: ref #1170014
2019-01-14 21:41:04 [DEBUG   ] summary = ERROR
2019-01-14 21:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170014  13 58497 78064821 A  ERRORERROR'
2019-01-14 21:41:04 [DEBUG   ] Got command RPT from MCS: ref #1170015
2019-01-14 21:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170015  77 58497 78064822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:41:04 [DEBUG   ] Got command RPT from MCS: ref #1170031
2019-01-14 21:41:04 [DEBUG   ] summary = ERROR
2019-01-14 21:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170031  13 58497 78064977 A  ERRORERROR'
2019-01-14 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1170032
2019-01-14 21:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170032  77 58497 78065181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1170033
2019-01-14 21:41:05 [DEBUG   ] summary = ERROR
2019-01-14 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170033  13 58497 78065385 A  ERRORERROR'
2019-01-14 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1170034
2019-01-14 21:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170034  77 58497 78065577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1170035
2019-01-14 21:41:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170035  12 58497 78065781 A  ERRORB¢ff'
2019-01-14 21:41:08 [DEBUG   ] Got command BAM from MCS: ref #1170036
2019-01-14 21:41:08 [INFO    ] Finished processing BAM request
2019-01-14 21:41:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170036   8 58497 78068033 A  ERROR'
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:41:08 [DEBUG   ] spawn_process: at 2019-01-14 21:41:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:41:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:41:34 [DEBUG   ] Got command BAM from MCS: ref #1170041
2019-01-14 21:41:34 [INFO    ] Finished processing BAM request
2019-01-14 21:41:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170041   8 58497 78094033 A  ERROR'
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:41:34 [DEBUG   ] spawn_process: at 2019-01-14 21:41:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:41:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:41:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 21:42:02 [DEBUG   ] Got command BAM from MCS: ref #1170042
2019-01-14 21:42:02 [INFO    ] Finished processing BAM request
2019-01-14 21:42:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170042   8 58497 78122033 A  ERROR'
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:42:02 [DEBUG   ] spawn_process: at 2019-01-14 21:42:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:42:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:42:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:42:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:42:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:42:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:42:03 [DEBUG   ] Finished updating board flags in 1.160 seconds
2019-01-14 21:42:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 21:42:38 [DEBUG   ] Got command BAM from MCS: ref #1170043
2019-01-14 21:42:38 [INFO    ] Finished processing BAM request
2019-01-14 21:42:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170043   8 58497 78158033 A  ERROR'
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:42:38 [DEBUG   ] spawn_process: at 2019-01-14 21:42:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:42:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 21:42:56 [DEBUG   ] Got command BAM from MCS: ref #1170044
2019-01-14 21:42:56 [INFO    ] Finished processing BAM request
2019-01-14 21:42:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:42:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170044   8 58497 78176025 A  ERROR'
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:42:56 [DEBUG   ] spawn_process: at 2019-01-14 21:42:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:42:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-14 21:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:43:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:43:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:43:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:43:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:43:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:43:03 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-01-14 21:43:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:43:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:43:42 [DEBUG   ] Got command BAM from MCS: ref #1170045
2019-01-14 21:43:42 [INFO    ] Finished processing BAM request
2019-01-14 21:43:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170045   8 58497 78222029 A  ERROR'
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:43:42 [DEBUG   ] spawn_process: at 2019-01-14 21:43:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:43:49 [DEBUG   ] Got command BAM from MCS: ref #1170046
2019-01-14 21:43:49 [INFO    ] Finished processing BAM request
2019-01-14 21:43:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170046   8 58497 78229025 A  ERROR'
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:43:49 [DEBUG   ] spawn_process: at 2019-01-14 21:43:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:43:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:44:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:44:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:44:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:44:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:44:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:44:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:44:03 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-14 21:44:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:44:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 21:44:42 [DEBUG   ] Got command BAM from MCS: ref #1170051
2019-01-14 21:44:42 [INFO    ] Finished processing BAM request
2019-01-14 21:44:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170051   8 58497 78282025 A  ERROR'
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:44:42 [DEBUG   ] spawn_process: at 2019-01-14 21:44:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:44:46 [DEBUG   ] Got command BAM from MCS: ref #1170052
2019-01-14 21:44:46 [INFO    ] Finished processing BAM request
2019-01-14 21:44:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170052   8 58497 78286025 A  ERROR'
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:44:46 [DEBUG   ] spawn_process: at 2019-01-14 21:44:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:44:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 21:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-14 21:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:45:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:45:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:45:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:45:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:45:03 [WARNING ] (13, 1, 'bot')
2019-01-14 21:45:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:45:03 [DEBUG   ] Finished updating board flags in 0.984 seconds
2019-01-14 21:45:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-14 21:45:35 [DEBUG   ] Got command BAM from MCS: ref #1170053
2019-01-14 21:45:35 [INFO    ] Finished processing BAM request
2019-01-14 21:45:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:45:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170053   8 58497 78335025 A  ERROR'
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:45:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:45:35 [DEBUG   ] spawn_process: at 2019-01-14 21:45:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:45:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:45:50 [DEBUG   ] Got command BAM from MCS: ref #1170054
2019-01-14 21:45:50 [INFO    ] Finished processing BAM request
2019-01-14 21:45:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:45:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170054   8 58497 78350033 A  ERROR'
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:45:50 [DEBUG   ] spawn_process: at 2019-01-14 21:45:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:46:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:46:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 21:46:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:46:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:46:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:46:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:46:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:46:04 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-01-14 21:46:04 [DEBUG   ] Got command RPT from MCS: ref #1170057
2019-01-14 21:46:04 [DEBUG   ] summary = ERROR
2019-01-14 21:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170057  13 58497 78364813 A  ERRORERROR'
2019-01-14 21:46:04 [DEBUG   ] Got command RPT from MCS: ref #1170058
2019-01-14 21:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170058  77 58497 78364814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1170074
2019-01-14 21:46:05 [DEBUG   ] summary = ERROR
2019-01-14 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170074  13 58497 78365065 A  ERRORERROR'
2019-01-14 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1170075
2019-01-14 21:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170075  77 58497 78365269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1170076
2019-01-14 21:46:05 [DEBUG   ] summary = ERROR
2019-01-14 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170076  13 58497 78365473 A  ERRORERROR'
2019-01-14 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1170078
2019-01-14 21:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170078  77 58497 78365665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1170080
2019-01-14 21:46:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170080  12 58497 78365869 A  ERRORB£ff'
2019-01-14 21:46:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:46:27 [DEBUG   ] Got command BAM from MCS: ref #1170084
2019-01-14 21:46:27 [INFO    ] Finished processing BAM request
2019-01-14 21:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170084   8 58497 78387025 A  ERROR'
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:46:27 [DEBUG   ] spawn_process: at 2019-01-14 21:46:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:46:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:46:54 [DEBUG   ] Got command BAM from MCS: ref #1170085
2019-01-14 21:46:54 [INFO    ] Finished processing BAM request
2019-01-14 21:46:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170085   8 58497 78414025 A  ERROR'
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:46:54 [DEBUG   ] spawn_process: at 2019-01-14 21:46:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:47:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-14 21:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:47:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:47:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 21:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:47:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:47:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:47:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:47:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:47:04 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-01-14 21:47:19 [DEBUG   ] Got command BAM from MCS: ref #1170090
2019-01-14 21:47:19 [INFO    ] Finished processing BAM request
2019-01-14 21:47:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170090   8 58497 78439029 A  ERROR'
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:47:19 [DEBUG   ] spawn_process: at 2019-01-14 21:47:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:47:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:47:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:47:58 [DEBUG   ] Got command BAM from MCS: ref #1170091
2019-01-14 21:47:58 [INFO    ] Finished processing BAM request
2019-01-14 21:47:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170091   8 58497 78478025 A  ERROR'
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:47:58 [DEBUG   ] spawn_process: at 2019-01-14 21:47:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 21:48:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 21:48:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:48:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 21:48:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:48:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:48:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:48:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:48:04 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-01-14 21:48:11 [DEBUG   ] Got command BAM from MCS: ref #1170092
2019-01-14 21:48:11 [INFO    ] Finished processing BAM request
2019-01-14 21:48:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170092   8 58497 78491025 A  ERROR'
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:48:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:48:11 [DEBUG   ] spawn_process: at 2019-01-14 21:48:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:48:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:48:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:49:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:49:02 [DEBUG   ] Got command BAM from MCS: ref #1170093
2019-01-14 21:49:02 [INFO    ] Finished processing BAM request
2019-01-14 21:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170093   8 58497 78542025 A  ERROR'
2019-01-14 21:49:02 [DEBUG   ] Got command BAM from MCS: ref #1170094
2019-01-14 21:49:02 [INFO    ] Finished processing BAM request
2019-01-14 21:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170094   8 58497 78542029 A  ERROR'
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:49:02 [DEBUG   ] spawn_process: at 2019-01-14 21:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-14 21:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 21:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:49:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:49:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 21:49:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:49:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:49:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:49:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:49:04 [DEBUG   ] Finished updating board flags in 1.261 seconds
2019-01-14 21:49:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:49:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:49:53 [DEBUG   ] Got command BAM from MCS: ref #1170095
2019-01-14 21:49:53 [INFO    ] Finished processing BAM request
2019-01-14 21:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170095   8 58497 78593029 A  ERROR'
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:49:53 [DEBUG   ] spawn_process: at 2019-01-14 21:49:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:50:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-14 21:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:50:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-14 21:50:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 21:50:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:50:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:50:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:50:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:50:05 [DEBUG   ] Finished updating board flags in 1.851 seconds
2019-01-14 21:50:06 [DEBUG   ] Got command BAM from MCS: ref #1170096
2019-01-14 21:50:06 [INFO    ] Finished processing BAM request
2019-01-14 21:50:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170096   8 58497 78606025 A  ERROR'
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:50:06 [DEBUG   ] spawn_process: at 2019-01-14 21:50:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:50:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:50:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:50:44 [DEBUG   ] Got command BAM from MCS: ref #1170101
2019-01-14 21:50:44 [INFO    ] Finished processing BAM request
2019-01-14 21:50:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170101   8 58497 78644029 A  ERROR'
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:50:44 [DEBUG   ] spawn_process: at 2019-01-14 21:50:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:51:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-14 21:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 21:51:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:51:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 21:51:04 [DEBUG   ] Got command RPT from MCS: ref #1170102
2019-01-14 21:51:04 [DEBUG   ] summary = ERROR
2019-01-14 21:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170102  13 58497 78664821 A  ERRORERROR'
2019-01-14 21:51:04 [DEBUG   ] Got command RPT from MCS: ref #1170103
2019-01-14 21:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170103  77 58497 78664822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:51:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:51:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:51:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:51:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:51:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:51:04 [DEBUG   ] Finished updating board flags in 1.144 seconds
2019-01-14 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1170119
2019-01-14 21:51:05 [DEBUG   ] summary = ERROR
2019-01-14 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170119  13 58497 78665157 A  ERRORERROR'
2019-01-14 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1170120
2019-01-14 21:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170120  77 58497 78665349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1170121
2019-01-14 21:51:05 [DEBUG   ] summary = ERROR
2019-01-14 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170121  13 58497 78665553 A  ERRORERROR'
2019-01-14 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1170122
2019-01-14 21:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170122  77 58497 78665757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1170123
2019-01-14 21:51:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170123  12 58497 78665961 A  ERRORB£ff'
2019-01-14 21:51:10 [DEBUG   ] Got command BAM from MCS: ref #1170124
2019-01-14 21:51:10 [INFO    ] Finished processing BAM request
2019-01-14 21:51:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170124   8 58497 78670033 A  ERROR'
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:51:10 [DEBUG   ] spawn_process: at 2019-01-14 21:51:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:51:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:51:34 [DEBUG   ] Got command BAM from MCS: ref #1170125
2019-01-14 21:51:34 [INFO    ] Finished processing BAM request
2019-01-14 21:51:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170125   8 58497 78694029 A  ERROR'
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:51:34 [DEBUG   ] spawn_process: at 2019-01-14 21:51:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:51:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:52:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 21:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:52:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:52:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:52:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:52:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:52:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:52:04 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-14 21:52:14 [DEBUG   ] Got command BAM from MCS: ref #1170126
2019-01-14 21:52:14 [INFO    ] Finished processing BAM request
2019-01-14 21:52:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170126   8 58497 78734029 A  ERROR'
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:52:14 [DEBUG   ] spawn_process: at 2019-01-14 21:52:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:52:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:52:24 [DEBUG   ] Got command BAM from MCS: ref #1170127
2019-01-14 21:52:24 [INFO    ] Finished processing BAM request
2019-01-14 21:52:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170127   8 58497 78744025 A  ERROR'
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:52:24 [DEBUG   ] spawn_process: at 2019-01-14 21:52:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:52:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:53:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:53:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:53:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-14 21:53:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:53:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:53:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:53:04 [WARNING ] (13, 1, 'bot')
2019-01-14 21:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:53:04 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-01-14 21:53:14 [DEBUG   ] Got command BAM from MCS: ref #1170132
2019-01-14 21:53:14 [INFO    ] Finished processing BAM request
2019-01-14 21:53:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170132   8 58497 78794025 A  ERROR'
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:53:14 [DEBUG   ] spawn_process: at 2019-01-14 21:53:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:53:18 [DEBUG   ] Got command BAM from MCS: ref #1170133
2019-01-14 21:53:18 [INFO    ] Finished processing BAM request
2019-01-14 21:53:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170133   8 58497 78798029 A  ERROR'
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:53:18 [DEBUG   ] spawn_process: at 2019-01-14 21:53:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:53:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:53:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:54:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:54:04 [DEBUG   ] Got command BAM from MCS: ref #1170134
2019-01-14 21:54:04 [INFO    ] Finished processing BAM request
2019-01-14 21:54:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170134   8 58497 78844025 A  ERROR'
2019-01-14 21:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:54:04 [DEBUG   ] spawn_process: at 2019-01-14 21:54:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:54:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 21:54:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:54:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:54:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:54:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:54:05 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-01-14 21:54:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:54:22 [DEBUG   ] Got command BAM from MCS: ref #1170135
2019-01-14 21:54:22 [INFO    ] Finished processing BAM request
2019-01-14 21:54:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170135   8 58497 78862033 A  ERROR'
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:54:22 [DEBUG   ] spawn_process: at 2019-01-14 21:54:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:54:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:54:53 [DEBUG   ] Got command BAM from MCS: ref #1170136
2019-01-14 21:54:53 [INFO    ] Finished processing BAM request
2019-01-14 21:54:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170136   8 58497 78893033 A  ERROR'
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:54:53 [DEBUG   ] spawn_process: at 2019-01-14 21:54:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:55:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:55:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 21:55:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:55:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:55:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:55:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:55:05 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-01-14 21:55:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 21:55:26 [DEBUG   ] Got command BAM from MCS: ref #1170137
2019-01-14 21:55:26 [INFO    ] Finished processing BAM request
2019-01-14 21:55:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170137   8 58497 78926033 A  ERROR'
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:55:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:55:26 [DEBUG   ] spawn_process: at 2019-01-14 21:55:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:55:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:55:42 [DEBUG   ] Got command BAM from MCS: ref #1170138
2019-01-14 21:55:42 [INFO    ] Finished processing BAM request
2019-01-14 21:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170138   8 58497 78942033 A  ERROR'
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:55:42 [DEBUG   ] spawn_process: at 2019-01-14 21:55:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:56:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 21:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:56:04 [DEBUG   ] Got command RPT from MCS: ref #1170141
2019-01-14 21:56:04 [DEBUG   ] summary = ERROR
2019-01-14 21:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170141  13 58497 78964817 A  ERRORERROR'
2019-01-14 21:56:04 [DEBUG   ] Got command RPT from MCS: ref #1170142
2019-01-14 21:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170142  77 58497 78964818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1170158
2019-01-14 21:56:05 [DEBUG   ] summary = ERROR
2019-01-14 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170158  13 58497 78965237 A  ERRORERROR'
2019-01-14 21:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-14 21:56:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:56:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:56:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:56:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:56:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:56:05 [DEBUG   ] Finished updating board flags in 1.201 seconds
2019-01-14 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1170159
2019-01-14 21:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170159  77 58497 78965445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1170160
2019-01-14 21:56:05 [DEBUG   ] summary = ERROR
2019-01-14 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170160  13 58497 78965637 A  ERRORERROR'
2019-01-14 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1170162
2019-01-14 21:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170162  77 58497 78965841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 21:56:06 [DEBUG   ] Got command RPT from MCS: ref #1170163
2019-01-14 21:56:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 21:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170163  12 58497 78966045 A  ERRORB£ff'
2019-01-14 21:56:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 21:56:30 [DEBUG   ] Got command BAM from MCS: ref #1170172
2019-01-14 21:56:30 [INFO    ] Finished processing BAM request
2019-01-14 21:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170172   8 58497 78990033 A  ERROR'
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:56:30 [DEBUG   ] spawn_process: at 2019-01-14 21:56:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:56:31 [DEBUG   ] Got command BAM from MCS: ref #1170173
2019-01-14 21:56:31 [INFO    ] Finished processing BAM request
2019-01-14 21:56:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170173   8 58497 78991025 A  ERROR'
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:56:31 [DEBUG   ] spawn_process: at 2019-01-14 21:56:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:56:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 21:57:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:57:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:57:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:57:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:57:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:57:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:57:05 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-14 21:57:19 [DEBUG   ] Got command BAM from MCS: ref #1170174
2019-01-14 21:57:19 [INFO    ] Finished processing BAM request
2019-01-14 21:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170174   8 58497 79039029 A  ERROR'
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:57:19 [DEBUG   ] spawn_process: at 2019-01-14 21:57:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:57:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:57:34 [DEBUG   ] Got command BAM from MCS: ref #1170175
2019-01-14 21:57:34 [INFO    ] Finished processing BAM request
2019-01-14 21:57:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170175   8 58497 79054025 A  ERROR'
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:57:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:57:34 [DEBUG   ] spawn_process: at 2019-01-14 21:57:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:57:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 21:58:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 21:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 21:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 21:58:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 21:58:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:58:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:58:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:58:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:58:05 [DEBUG   ] Finished updating board flags in 1.180 seconds
2019-01-14 21:58:07 [DEBUG   ] Got command BAM from MCS: ref #1170176
2019-01-14 21:58:07 [INFO    ] Finished processing BAM request
2019-01-14 21:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170176   8 58497 79087033 A  ERROR'
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 21:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 21:58:07 [DEBUG   ] spawn_process: at 2019-01-14 21:58:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 21:58:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:58:38 [DEBUG   ] Got command BAM from MCS: ref #1170177
2019-01-14 21:58:38 [INFO    ] Finished processing BAM request
2019-01-14 21:58:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170177   8 58497 79118025 A  ERROR'
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 21:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 21:58:38 [DEBUG   ] spawn_process: at 2019-01-14 21:58:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 21:58:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:58:55 [DEBUG   ] Got command BAM from MCS: ref #1170178
2019-01-14 21:58:55 [INFO    ] Finished processing BAM request
2019-01-14 21:58:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170178   8 58497 79135029 A  ERROR'
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 21:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 21:58:55 [DEBUG   ] spawn_process: at 2019-01-14 21:58:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 21:59:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 21:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 21:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-14 21:59:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 21:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 21:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 21:59:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:59:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:59:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:59:05 [WARNING ] (13, 1, 'bot')
2019-01-14 21:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 21:59:05 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-14 21:59:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 21:59:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 21:59:42 [DEBUG   ] Got command BAM from MCS: ref #1170183
2019-01-14 21:59:42 [INFO    ] Finished processing BAM request
2019-01-14 21:59:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170183   8 58497 79182025 A  ERROR'
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 21:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 21:59:42 [DEBUG   ] spawn_process: at 2019-01-14 21:59:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 21:59:43 [DEBUG   ] Got command BAM from MCS: ref #1170184
2019-01-14 21:59:43 [INFO    ] Finished processing BAM request
2019-01-14 21:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 21:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170184   8 58497 79183025 A  ERROR'
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 21:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 21:59:43 [DEBUG   ] spawn_process: at 2019-01-14 21:59:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 22:00:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 22:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-14 22:00:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:00:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:00:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:00:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:00:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:00:05 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-01-14 22:00:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:00:31 [DEBUG   ] Got command BAM from MCS: ref #1170185
2019-01-14 22:00:31 [INFO    ] Finished processing BAM request
2019-01-14 22:00:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170185   8 58497 79231026 A  ERROR'
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:00:31 [DEBUG   ] spawn_process: at 2019-01-14 22:00:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:00:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:00:46 [DEBUG   ] Got command BAM from MCS: ref #1170186
2019-01-14 22:00:46 [INFO    ] Finished processing BAM request
2019-01-14 22:00:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:00:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170186   8 58497 79246030 A  ERROR'
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:00:46 [DEBUG   ] spawn_process: at 2019-01-14 22:00:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:01:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:01:04 [DEBUG   ] Got command RPT from MCS: ref #1170187
2019-01-14 22:01:04 [DEBUG   ] summary = ERROR
2019-01-14 22:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170187  13 58497 79264825 A  ERRORERROR'
2019-01-14 22:01:04 [DEBUG   ] Got command RPT from MCS: ref #1170188
2019-01-14 22:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170188  77 58497 79264826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1170204
2019-01-14 22:01:05 [DEBUG   ] summary = ERROR
2019-01-14 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170204  13 58497 79265326 A  ERRORERROR'
2019-01-14 22:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1170205
2019-01-14 22:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170205  77 58497 79265525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1170206
2019-01-14 22:01:05 [DEBUG   ] summary = ERROR
2019-01-14 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170206  13 58497 79265729 A  ERRORERROR'
2019-01-14 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1170207
2019-01-14 22:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170207  77 58497 79265921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:01:06 [DEBUG   ] Got command RPT from MCS: ref #1170208
2019-01-14 22:01:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170208  12 58497 79266126 A  ERRORB›™š'
2019-01-14 22:01:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 22:01:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:01:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:01:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:01:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:01:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:01:06 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-14 22:01:18 [DEBUG   ] Got command BAM from MCS: ref #1170209
2019-01-14 22:01:18 [INFO    ] Finished processing BAM request
2019-01-14 22:01:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170209   8 58497 79278033 A  ERROR'
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 22:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 22:01:18 [DEBUG   ] spawn_process: at 2019-01-14 22:01:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 22:01:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:01:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:01:50 [DEBUG   ] Got command BAM from MCS: ref #1170210
2019-01-14 22:01:50 [INFO    ] Finished processing BAM request
2019-01-14 22:01:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170210   8 58497 79310033 A  ERROR'
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 22:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 22:01:50 [DEBUG   ] spawn_process: at 2019-01-14 22:01:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 22:02:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:02:05 [DEBUG   ] Got command BAM from MCS: ref #1170211
2019-01-14 22:02:05 [INFO    ] Finished processing BAM request
2019-01-14 22:02:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170211   8 58497 79325029 A  ERROR'
2019-01-14 22:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 22:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-14 22:02:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 22:02:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 22:02:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:02:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:02:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:02:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:02:05 [DEBUG   ] Finished updating board flags in 1.246 seconds
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 22:02:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 22:02:05 [DEBUG   ] spawn_process: at 2019-01-14 22:02:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 22:02:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:02:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:02:52 [DEBUG   ] Got command BAM from MCS: ref #1170216
2019-01-14 22:02:52 [INFO    ] Finished processing BAM request
2019-01-14 22:02:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:02:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170216   8 58497 79372025 A  ERROR'
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 22:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 22:02:52 [DEBUG   ] spawn_process: at 2019-01-14 22:02:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 22:02:54 [DEBUG   ] Got command BAM from MCS: ref #1170217
2019-01-14 22:02:54 [INFO    ] Finished processing BAM request
2019-01-14 22:02:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:02:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170217   8 58497 79374033 A  ERROR'
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:02:54 [DEBUG   ] spawn_process: at 2019-01-14 22:02:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:03:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 22:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 22:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:03:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-14 22:03:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:03:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:03:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:03:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:03:05 [DEBUG   ] Finished updating board flags in 1.203 seconds
2019-01-14 22:03:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:03:39 [DEBUG   ] Got command BAM from MCS: ref #1170218
2019-01-14 22:03:39 [INFO    ] Finished processing BAM request
2019-01-14 22:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170218   8 58497 79419029 A  ERROR'
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:03:39 [DEBUG   ] spawn_process: at 2019-01-14 22:03:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:03:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:03:58 [DEBUG   ] Got command BAM from MCS: ref #1170219
2019-01-14 22:03:58 [INFO    ] Finished processing BAM request
2019-01-14 22:03:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170219   8 58497 79438030 A  ERROR'
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:03:58 [DEBUG   ] spawn_process: at 2019-01-14 22:03:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:04:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:04:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 22:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 22:04:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:04:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:04:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:04:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:04:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:04:05 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-01-14 22:04:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:04:25 [DEBUG   ] Got command BAM from MCS: ref #1170220
2019-01-14 22:04:25 [INFO    ] Finished processing BAM request
2019-01-14 22:04:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170220   8 58497 79465034 A  ERROR'
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 22:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 22:04:25 [DEBUG   ] spawn_process: at 2019-01-14 22:04:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 22:04:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:05:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:05:02 [DEBUG   ] Got command BAM from MCS: ref #1170221
2019-01-14 22:05:02 [INFO    ] Finished processing BAM request
2019-01-14 22:05:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170221   8 58497 79502026 A  ERROR'
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:05:02 [DEBUG   ] spawn_process: at 2019-01-14 22:05:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 22:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:05:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:05:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:05:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:05:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:05:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:05:05 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-14 22:05:11 [DEBUG   ] Got command BAM from MCS: ref #1170222
2019-01-14 22:05:11 [INFO    ] Finished processing BAM request
2019-01-14 22:05:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170222   8 58497 79511034 A  ERROR'
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:05:11 [DEBUG   ] spawn_process: at 2019-01-14 22:05:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:05:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 22:05:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:05:57 [DEBUG   ] Got command BAM from MCS: ref #1170229
2019-01-14 22:05:57 [INFO    ] Finished processing BAM request
2019-01-14 22:05:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170229   8 58497 79557034 A  ERROR'
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:05:57 [DEBUG   ] spawn_process: at 2019-01-14 22:05:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:06:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:06:04 [DEBUG   ] Got command RPT from MCS: ref #1170230
2019-01-14 22:06:04 [DEBUG   ] summary = ERROR
2019-01-14 22:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170230  13 58497 79564821 A  ERRORERROR'
2019-01-14 22:06:04 [DEBUG   ] Got command RPT from MCS: ref #1170231
2019-01-14 22:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170231  77 58497 79564822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-14 22:06:05 [DEBUG   ] Got command RPT from MCS: ref #1170248
2019-01-14 22:06:05 [DEBUG   ] summary = ERROR
2019-01-14 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170248  13 58497 79565410 A  ERRORERROR'
2019-01-14 22:06:05 [DEBUG   ] Got command RPT from MCS: ref #1170249
2019-01-14 22:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170249  77 58497 79565614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:06:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:06:05 [DEBUG   ] Got command RPT from MCS: ref #1170250
2019-01-14 22:06:05 [DEBUG   ] summary = ERROR
2019-01-14 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170250  13 58497 79565806 A  ERRORERROR'
2019-01-14 22:06:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:06:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:06:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:06:05 [WARNING ] (13, 1, 'bot')
2019-01-14 22:06:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:06:05 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-01-14 22:06:06 [DEBUG   ] Got command RPT from MCS: ref #1170252
2019-01-14 22:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170252  77 58497 79566010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:06:06 [DEBUG   ] Got command BAM from MCS: ref #1170247
2019-01-14 22:06:06 [INFO    ] Finished processing BAM request
2019-01-14 22:06:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170247   8 58497 79566026 A  ERROR'
2019-01-14 22:06:06 [DEBUG   ] Got command RPT from MCS: ref #1170254
2019-01-14 22:06:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170254  12 58497 79566217 A  ERRORB¢ff'
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:06:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:06:06 [DEBUG   ] spawn_process: at 2019-01-14 22:06:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:06:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:06:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:06:43 [DEBUG   ] Got command BAM from MCS: ref #1170258
2019-01-14 22:06:43 [INFO    ] Finished processing BAM request
2019-01-14 22:06:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170258   8 58497 79603026 A  ERROR'
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 22:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 22:06:43 [DEBUG   ] spawn_process: at 2019-01-14 22:06:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 22:07:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-14 22:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 22:07:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:07:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:07:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:07:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:07:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:07:06 [DEBUG   ] Finished updating board flags in 1.629 seconds
2019-01-14 22:07:10 [DEBUG   ] Got command BAM from MCS: ref #1170259
2019-01-14 22:07:10 [INFO    ] Finished processing BAM request
2019-01-14 22:07:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170259   8 58497 79630033 A  ERROR'
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:07:10 [DEBUG   ] spawn_process: at 2019-01-14 22:07:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:07:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:07:29 [DEBUG   ] Got command BAM from MCS: ref #1170260
2019-01-14 22:07:29 [INFO    ] Finished processing BAM request
2019-01-14 22:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170260   8 58497 79649025 A  ERROR'
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:07:29 [DEBUG   ] spawn_process: at 2019-01-14 22:07:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:07:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:08:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 22:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 22:08:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:08:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:08:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:08:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:08:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:08:06 [DEBUG   ] Finished updating board flags in 1.523 seconds
2019-01-14 22:08:14 [DEBUG   ] Got command BAM from MCS: ref #1170266
2019-01-14 22:08:14 [INFO    ] Finished processing BAM request
2019-01-14 22:08:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170266   8 58497 79694029 A  ERROR'
2019-01-14 22:08:14 [DEBUG   ] Got command BAM from MCS: ref #1170265
2019-01-14 22:08:14 [INFO    ] Finished processing BAM request
2019-01-14 22:08:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170265   8 58497 79694033 A  ERROR'
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:08:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:08:14 [DEBUG   ] spawn_process: at 2019-01-14 22:08:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:08:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:08:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:08:59 [DEBUG   ] Got command BAM from MCS: ref #1170267
2019-01-14 22:08:59 [INFO    ] Finished processing BAM request
2019-01-14 22:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170267   8 58497 79739029 A  ERROR'
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:08:59 [DEBUG   ] spawn_process: at 2019-01-14 22:08:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:09:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 22:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:09:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:09:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:09:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:09:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:09:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:09:06 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-14 22:09:18 [DEBUG   ] Got command BAM from MCS: ref #1170268
2019-01-14 22:09:18 [INFO    ] Finished processing BAM request
2019-01-14 22:09:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170268   8 58497 79758033 A  ERROR'
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:09:18 [DEBUG   ] spawn_process: at 2019-01-14 22:09:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:09:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 22:09:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:09:44 [DEBUG   ] Got command BAM from MCS: ref #1170269
2019-01-14 22:09:44 [INFO    ] Finished processing BAM request
2019-01-14 22:09:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170269   8 58497 79784025 A  ERROR'
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 22:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 22:09:44 [DEBUG   ] spawn_process: at 2019-01-14 22:09:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 22:10:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:10:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 22:10:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:10:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:10:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:10:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:10:06 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-14 22:10:20 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-14 22:10:22 [DEBUG   ] Got command BAM from MCS: ref #1170270
2019-01-14 22:10:22 [INFO    ] Finished processing BAM request
2019-01-14 22:10:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170270   8 58497 79822025 A  ERROR'
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:10:22 [DEBUG   ] spawn_process: at 2019-01-14 22:10:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:10:29 [DEBUG   ] Got command BAM from MCS: ref #1170271
2019-01-14 22:10:29 [INFO    ] Finished processing BAM request
2019-01-14 22:10:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170271   8 58497 79829029 A  ERROR'
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 22:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 22:10:29 [DEBUG   ] spawn_process: at 2019-01-14 22:10:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 22:10:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:11:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:11:04 [DEBUG   ] Got command RPT from MCS: ref #1170272
2019-01-14 22:11:04 [DEBUG   ] summary = ERROR
2019-01-14 22:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170272  13 58497 79864829 A  ERRORERROR'
2019-01-14 22:11:04 [DEBUG   ] Got command RPT from MCS: ref #1170273
2019-01-14 22:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170273  77 58497 79864830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 22:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-14 22:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:11:05 [DEBUG   ] Got command RPT from MCS: ref #1170289
2019-01-14 22:11:05 [DEBUG   ] summary = ERROR
2019-01-14 22:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170289  13 58497 79865501 A  ERRORERROR'
2019-01-14 22:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-14 22:11:05 [DEBUG   ] Got command RPT from MCS: ref #1170290
2019-01-14 22:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170290  77 58497 79865693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:11:05 [DEBUG   ] Got command RPT from MCS: ref #1170291
2019-01-14 22:11:05 [DEBUG   ] summary = ERROR
2019-01-14 22:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170291  13 58497 79865897 A  ERRORERROR'
2019-01-14 22:11:06 [DEBUG   ] Got command RPT from MCS: ref #1170292
2019-01-14 22:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170292  77 58497 79866101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:11:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:11:06 [DEBUG   ] Got command RPT from MCS: ref #1170293
2019-01-14 22:11:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170293  12 58497 79866297 A  ERRORB£ff'
2019-01-14 22:11:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:11:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:11:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:11:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:11:06 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-14 22:11:14 [DEBUG   ] Got command BAM from MCS: ref #1170298
2019-01-14 22:11:14 [INFO    ] Finished processing BAM request
2019-01-14 22:11:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170298   8 58497 79874033 A  ERROR'
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:11:14 [DEBUG   ] spawn_process: at 2019-01-14 22:11:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:11:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:11:26 [DEBUG   ] Got command BAM from MCS: ref #1170299
2019-01-14 22:11:26 [INFO    ] Finished processing BAM request
2019-01-14 22:11:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170299   8 58497 79886033 A  ERROR'
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 22:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 22:11:26 [DEBUG   ] spawn_process: at 2019-01-14 22:11:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 22:11:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:11:59 [DEBUG   ] Got command BAM from MCS: ref #1170300
2019-01-14 22:11:59 [INFO    ] Finished processing BAM request
2019-01-14 22:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170300   8 58497 79919025 A  ERROR'
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:11:59 [DEBUG   ] spawn_process: at 2019-01-14 22:11:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:12:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 22:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-14 22:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 22:12:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:12:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:12:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:12:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:12:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:12:06 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-01-14 22:12:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:12:30 [DEBUG   ] Got command BAM from MCS: ref #1170301
2019-01-14 22:12:30 [INFO    ] Finished processing BAM request
2019-01-14 22:12:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170301   8 58497 79950029 A  ERROR'
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 22:12:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 22:12:30 [DEBUG   ] spawn_process: at 2019-01-14 22:12:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 22:12:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:12:43 [DEBUG   ] Got command BAM from MCS: ref #1170302
2019-01-14 22:12:43 [INFO    ] Finished processing BAM request
2019-01-14 22:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170302   8 58497 79963025 A  ERROR'
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-14 22:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-14 22:12:43 [DEBUG   ] spawn_process: at 2019-01-14 22:12:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-14 22:13:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 22:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:13:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 22:13:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:13:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:13:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:13:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:13:06 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-01-14 22:13:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:13:27 [DEBUG   ] Got command BAM from MCS: ref #1170303
2019-01-14 22:13:27 [INFO    ] Finished processing BAM request
2019-01-14 22:13:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170303   8 58497 80007029 A  ERROR'
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 22:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 22:13:27 [DEBUG   ] spawn_process: at 2019-01-14 22:13:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 22:13:34 [DEBUG   ] Got command BAM from MCS: ref #1170304
2019-01-14 22:13:34 [INFO    ] Finished processing BAM request
2019-01-14 22:13:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170304   8 58497 80014029 A  ERROR'
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-14 22:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-14 22:13:34 [DEBUG   ] spawn_process: at 2019-01-14 22:13:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-14 22:13:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:14:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:14:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 22:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:14:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 22:14:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:14:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:14:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:14:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:14:06 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-14 22:14:11 [DEBUG   ] Got command BAM from MCS: ref #1170305
2019-01-14 22:14:11 [INFO    ] Finished processing BAM request
2019-01-14 22:14:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170305   8 58497 80051025 A  ERROR'
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 22:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 22:14:11 [DEBUG   ] spawn_process: at 2019-01-14 22:14:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 22:14:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:14:38 [DEBUG   ] Got command BAM from MCS: ref #1170310
2019-01-14 22:14:38 [INFO    ] Finished processing BAM request
2019-01-14 22:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170310   8 58497 80078033 A  ERROR'
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 22:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 22:14:38 [DEBUG   ] spawn_process: at 2019-01-14 22:14:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 22:14:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:14:55 [DEBUG   ] Got command BAM from MCS: ref #1170311
2019-01-14 22:14:55 [INFO    ] Finished processing BAM request
2019-01-14 22:14:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170311   8 58497 80095033 A  ERROR'
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 22:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 22:14:55 [DEBUG   ] spawn_process: at 2019-01-14 22:14:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 22:15:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:15:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-14 22:15:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:15:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:15:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:15:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:15:07 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-14 22:15:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:15:39 [DEBUG   ] Got command BAM from MCS: ref #1170312
2019-01-14 22:15:39 [INFO    ] Finished processing BAM request
2019-01-14 22:15:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170312   8 58497 80139029 A  ERROR'
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-14 22:15:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-14 22:15:39 [DEBUG   ] spawn_process: at 2019-01-14 22:15:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-14 22:15:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:15:42 [DEBUG   ] Got command BAM from MCS: ref #1170313
2019-01-14 22:15:42 [INFO    ] Finished processing BAM request
2019-01-14 22:15:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-14 22:15:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1170313   8 58497 80142029 A  ERROR'
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-14 22:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-14 22:15:42 [DEBUG   ] spawn_process: at 2019-01-14 22:15:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-14 22:16:00 [DEBUG   ] Got command STP from MCS: ref #1170317
2019-01-14 22:16:00 [INFO    ] Finished processing BAM request
2019-01-14 22:16:00 [INFO    ] Shutdown the adder chain on beam #2
2019-01-14 22:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1170317   8 58497 80160033 A  ERROR'
2019-01-14 22:16:00 [DEBUG   ] Got command STP from MCS: ref #1170316
2019-01-14 22:16:00 [INFO    ] Finished processing BAM request
2019-01-14 22:16:00 [INFO    ] Shutdown the adder chain on beam #3
2019-01-14 22:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1170316   8 58497 80160037 A  ERROR'
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-14 22:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-14 22:16:00 [DEBUG   ] spawn_process: at 2019-01-14 22:16:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-14 22:16:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:16:04 [DEBUG   ] Got command RPT from MCS: ref #1170318
2019-01-14 22:16:04 [DEBUG   ] summary = ERROR
2019-01-14 22:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170318  13 58497 80164821 A  ERRORERROR'
2019-01-14 22:16:04 [DEBUG   ] Got command RPT from MCS: ref #1170319
2019-01-14 22:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170319  77 58497 80164822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:16:05 [DEBUG   ] Got command RPT from MCS: ref #1170335
2019-01-14 22:16:05 [DEBUG   ] summary = ERROR
2019-01-14 22:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170335  13 58497 80165589 A  ERRORERROR'
2019-01-14 22:16:05 [DEBUG   ] Got command RPT from MCS: ref #1170336
2019-01-14 22:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170336  77 58497 80165781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:16:05 [DEBUG   ] Got command RPT from MCS: ref #1170337
2019-01-14 22:16:05 [DEBUG   ] summary = ERROR
2019-01-14 22:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170337  13 58497 80165985 A  ERRORERROR'
2019-01-14 22:16:06 [DEBUG   ] Got command RPT from MCS: ref #1170339
2019-01-14 22:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170339  77 58497 80166189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-14 22:16:06 [DEBUG   ] Got command RPT from MCS: ref #1170341
2019-01-14 22:16:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170341  12 58497 80166381 A  ERRORB–™š'
2019-01-14 22:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:16:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-14 22:16:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:16:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:16:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:16:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:16:06 [DEBUG   ] Finished updating board flags in 1.227 seconds
2019-01-14 22:16:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:16:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:17:01 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2019-01-14 22:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:17:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:17:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:17:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:17:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:17:06 [DEBUG   ] Finished updating board flags in 1.234 seconds
2019-01-14 22:17:21 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2019-01-14 22:17:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:18:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 22:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:18:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:18:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:18:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:18:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:18:06 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-01-14 22:18:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:18:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 22:19:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:19:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:19:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:19:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:19:06 [WARNING ] (13, 1, 'bot')
2019-01-14 22:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:19:06 [DEBUG   ] Finished updating board flags in 1.035 seconds
2019-01-14 22:19:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:19:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:20:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:20:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:20:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:20:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:20:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:20:07 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-14 22:20:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 22:20:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:21:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:21:04 [DEBUG   ] Got command RPT from MCS: ref #1170353
2019-01-14 22:21:04 [DEBUG   ] summary = ERROR
2019-01-14 22:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170353  13 58497 80464821 A  ERRORERROR'
2019-01-14 22:21:04 [DEBUG   ] Got command RPT from MCS: ref #1170354
2019-01-14 22:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170354  77 58497 80464822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:21:05 [DEBUG   ] Got command RPT from MCS: ref #1170370
2019-01-14 22:21:05 [DEBUG   ] summary = ERROR
2019-01-14 22:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170370  13 58497 80465661 A  ERRORERROR'
2019-01-14 22:21:05 [DEBUG   ] Got command RPT from MCS: ref #1170371
2019-01-14 22:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170371  77 58497 80465865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:21:06 [DEBUG   ] Got command RPT from MCS: ref #1170372
2019-01-14 22:21:06 [DEBUG   ] summary = ERROR
2019-01-14 22:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170372  13 58497 80466069 A  ERRORERROR'
2019-01-14 22:21:06 [DEBUG   ] Got command RPT from MCS: ref #1170373
2019-01-14 22:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170373  77 58497 80466262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:21:06 [DEBUG   ] Got command RPT from MCS: ref #1170374
2019-01-14 22:21:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170374  12 58497 80466465 A  ERRORBŽÌÍ'
2019-01-14 22:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:21:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:21:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:21:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:21:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:21:07 [DEBUG   ] Finished updating board flags in 1.315 seconds
2019-01-14 22:21:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:21:42 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-14 22:22:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:22:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:22:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:22:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:22:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:22:07 [DEBUG   ] Finished updating board flags in 1.223 seconds
2019-01-14 22:22:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:22:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:23:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:23:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:23:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:23:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:23:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:23:07 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-01-14 22:23:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:23:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:24:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:24:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:24:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:24:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:24:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:24:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:24:07 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-14 22:24:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:24:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:25:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:25:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:25:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:25:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:25:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:25:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:25:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:25:07 [DEBUG   ] Finished updating board flags in 1.083 seconds
2019-01-14 22:25:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 22:25:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:26:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:26:04 [DEBUG   ] Got command RPT from MCS: ref #1170381
2019-01-14 22:26:04 [DEBUG   ] summary = ERROR
2019-01-14 22:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170381  13 58497 80764829 A  ERRORERROR'
2019-01-14 22:26:04 [DEBUG   ] Got command RPT from MCS: ref #1170382
2019-01-14 22:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170382  77 58497 80764830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:26:05 [DEBUG   ] Got command RPT from MCS: ref #1170398
2019-01-14 22:26:05 [DEBUG   ] summary = ERROR
2019-01-14 22:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170398  13 58497 80765741 A  ERRORERROR'
2019-01-14 22:26:05 [DEBUG   ] Got command RPT from MCS: ref #1170399
2019-01-14 22:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170399  77 58497 80765945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:26:06 [DEBUG   ] Got command RPT from MCS: ref #1170400
2019-01-14 22:26:06 [DEBUG   ] summary = ERROR
2019-01-14 22:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170400  13 58497 80766149 A  ERRORERROR'
2019-01-14 22:26:06 [DEBUG   ] Got command RPT from MCS: ref #1170401
2019-01-14 22:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170401  77 58497 80766341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:26:06 [DEBUG   ] Got command RPT from MCS: ref #1170403
2019-01-14 22:26:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170403  12 58497 80766545 A  ERRORB˜™š'
2019-01-14 22:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:26:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:26:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:26:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:26:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:26:08 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-14 22:26:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:26:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:27:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 22:27:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:27:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:27:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:27:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:27:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:27:07 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-01-14 22:27:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 22:27:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:28:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 22:28:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:28:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:28:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:28:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:28:07 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-01-14 22:28:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:28:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:29:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 22:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:29:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 22:29:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:29:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:29:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:29:07 [WARNING ] (13, 1, 'bot')
2019-01-14 22:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:29:07 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-01-14 22:29:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:29:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:30:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 22:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:30:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:30:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:30:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:30:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:30:08 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-01-14 22:30:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:30:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:31:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:31:04 [DEBUG   ] Got command RPT from MCS: ref #1170416
2019-01-14 22:31:04 [DEBUG   ] summary = ERROR
2019-01-14 22:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170416  13 58497 81064833 A  ERRORERROR'
2019-01-14 22:31:04 [DEBUG   ] Got command RPT from MCS: ref #1170417
2019-01-14 22:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170417  77 58497 81064834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:31:05 [DEBUG   ] Got command RPT from MCS: ref #1170433
2019-01-14 22:31:05 [DEBUG   ] summary = ERROR
2019-01-14 22:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170433  13 58497 81065817 A  ERRORERROR'
2019-01-14 22:31:06 [DEBUG   ] Got command RPT from MCS: ref #1170434
2019-01-14 22:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170434  77 58497 81066021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:31:06 [DEBUG   ] Got command RPT from MCS: ref #1170435
2019-01-14 22:31:06 [DEBUG   ] summary = ERROR
2019-01-14 22:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170435  13 58497 81066225 A  ERRORERROR'
2019-01-14 22:31:06 [DEBUG   ] Got command RPT from MCS: ref #1170436
2019-01-14 22:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170436  77 58497 81066417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:31:06 [DEBUG   ] Got command RPT from MCS: ref #1170437
2019-01-14 22:31:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170437  12 58497 81066621 A  ERRORB˜™š'
2019-01-14 22:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:31:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:31:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:31:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:31:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:31:08 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-01-14 22:31:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:31:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:32:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 22:32:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:32:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:32:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:32:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:32:08 [DEBUG   ] Finished updating board flags in 1.248 seconds
2019-01-14 22:32:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:32:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:33:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:33:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:33:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:33:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:33:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:33:08 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-01-14 22:33:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 22:33:42 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-01-14 22:34:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 22:34:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:34:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:34:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:34:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:34:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:34:08 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-01-14 22:34:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-14 22:34:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:35:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:35:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:35:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:35:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:35:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:35:08 [DEBUG   ] Finished updating board flags in 1.119 seconds
2019-01-14 22:35:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:35:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:36:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:36:04 [DEBUG   ] Got command RPT from MCS: ref #1170448
2019-01-14 22:36:04 [DEBUG   ] summary = ERROR
2019-01-14 22:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170448  13 58497 81364833 A  ERRORERROR'
2019-01-14 22:36:04 [DEBUG   ] Got command RPT from MCS: ref #1170449
2019-01-14 22:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170449  77 58497 81364834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:36:05 [DEBUG   ] Got command RPT from MCS: ref #1170465
2019-01-14 22:36:05 [DEBUG   ] summary = ERROR
2019-01-14 22:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170465  13 58497 81365901 A  ERRORERROR'
2019-01-14 22:36:06 [DEBUG   ] Got command RPT from MCS: ref #1170466
2019-01-14 22:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170466  77 58497 81366105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:36:06 [DEBUG   ] Got command RPT from MCS: ref #1170467
2019-01-14 22:36:06 [DEBUG   ] summary = ERROR
2019-01-14 22:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170467  13 58497 81366297 A  ERRORERROR'
2019-01-14 22:36:06 [DEBUG   ] Got command RPT from MCS: ref #1170469
2019-01-14 22:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170469  77 58497 81366501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:36:06 [DEBUG   ] Got command RPT from MCS: ref #1170470
2019-01-14 22:36:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170470  12 58497 81366705 A  ERRORB™™š'
2019-01-14 22:36:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:36:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:36:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:36:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:36:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:36:08 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-01-14 22:36:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:36:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:37:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:37:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:37:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:37:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:37:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:37:08 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-01-14 22:37:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:37:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:38:00 [DEBUG   ] Got command TBN from MCS: ref #1170475
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-14 22:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1170475   8 58497 81480641 A  ERROR'
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547505482']
2019-01-14 22:38:00 [DEBUG   ] spawn_process: at 2019-01-14 22:38:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547505482']
2019-01-14 22:38:00 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-14 22:38:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 22:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 22:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:38:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:38:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:38:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:38:08 [WARNING ] (13, 1, 'bot')
2019-01-14 22:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:38:08 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-14 22:38:22 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2019-01-14 22:38:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 22:39:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 22:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:39:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:39:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:39:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:39:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:39:09 [DEBUG   ] Finished updating board flags in 2.044 seconds
2019-01-14 22:39:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 22:39:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 22:40:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 22:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:40:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:40:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:40:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:40:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:40:09 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-14 22:40:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:40:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 22:41:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 22:41:04 [DEBUG   ] Got command RPT from MCS: ref #1170480
2019-01-14 22:41:04 [DEBUG   ] summary = ERROR
2019-01-14 22:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170480  13 58497 81664829 A  ERRORERROR'
2019-01-14 22:41:04 [DEBUG   ] Got command RPT from MCS: ref #1170481
2019-01-14 22:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170481  77 58497 81664830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:41:05 [DEBUG   ] Got command RPT from MCS: ref #1170497
2019-01-14 22:41:05 [DEBUG   ] summary = ERROR
2019-01-14 22:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170497  13 58497 81665981 A  ERRORERROR'
2019-01-14 22:41:06 [DEBUG   ] Got command RPT from MCS: ref #1170498
2019-01-14 22:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170498  77 58497 81666185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:41:06 [DEBUG   ] Got command RPT from MCS: ref #1170499
2019-01-14 22:41:06 [DEBUG   ] summary = ERROR
2019-01-14 22:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170499  13 58497 81666389 A  ERRORERROR'
2019-01-14 22:41:06 [DEBUG   ] Got command RPT from MCS: ref #1170500
2019-01-14 22:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170500  77 58497 81666581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:41:06 [DEBUG   ] Got command RPT from MCS: ref #1170501
2019-01-14 22:41:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170501  12 58497 81666785 A  ERRORB˜™š'
2019-01-14 22:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:41:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:41:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:41:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:41:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:41:09 [DEBUG   ] Finished updating board flags in 1.954 seconds
2019-01-14 22:41:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-14 22:41:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:42:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 22:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:42:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:42:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:42:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:42:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:42:09 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-14 22:42:11 [DEBUG   ] Got command TBW from MCS: ref #1170507
2019-01-14 22:42:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-14 22:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1170507   8 58497 81731710 A  ERROR'
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-14 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-14 22:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-14 22:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-14 22:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-14 22:42:15 [DEBUG   ] spawn_process: at 2019-01-14 22:42:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-14 22:42:15 [INFO    ] Finished spawning TBW
2019-01-14 22:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:43:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:43:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:43:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:43:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:43:09 [DEBUG   ] Finished updating board flags in 1.553 seconds
2019-01-14 22:44:03 [INFO    ] __waitForTBW - TBW finished in 108.622 s
2019-01-14 22:44:04 [DEBUG   ] Finished updating ant stats in 0.438 seconds
2019-01-14 22:44:04 [INFO    ] Started antennas statistics background thread
2019-01-14 22:44:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547505846']
2019-01-14 22:44:04 [DEBUG   ] spawn_process: at 2019-01-14 22:44:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547505846']
2019-01-14 22:44:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-14 22:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:44:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:44:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:44:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:44:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:44:09 [DEBUG   ] Finished updating board flags in 1.256 seconds
2019-01-14 22:44:24 [DEBUG   ] Finished updating ant stats in 0.462 seconds
2019-01-14 22:44:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 22:45:04 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-14 22:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-14 22:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:45:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:45:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:45:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:45:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:45:09 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-01-14 22:45:25 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-14 22:45:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 22:46:04 [DEBUG   ] Got command RPT from MCS: ref #1170521
2019-01-14 22:46:04 [DEBUG   ] summary = ERROR
2019-01-14 22:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170521  13 58497 81964837 A  ERRORERROR'
2019-01-14 22:46:04 [DEBUG   ] Got command RPT from MCS: ref #1170522
2019-01-14 22:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170522  77 58497 81964838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:46:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 22:46:06 [DEBUG   ] Got command RPT from MCS: ref #1170538
2019-01-14 22:46:06 [DEBUG   ] summary = ERROR
2019-01-14 22:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170538  13 58497 81966061 A  ERRORERROR'
2019-01-14 22:46:06 [DEBUG   ] Got command RPT from MCS: ref #1170539
2019-01-14 22:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170539  77 58497 81966265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:46:06 [DEBUG   ] Got command RPT from MCS: ref #1170540
2019-01-14 22:46:06 [DEBUG   ] summary = ERROR
2019-01-14 22:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170540  13 58497 81966469 A  ERRORERROR'
2019-01-14 22:46:06 [DEBUG   ] Got command RPT from MCS: ref #1170542
2019-01-14 22:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170542  77 58497 81966673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:46:06 [DEBUG   ] Got command RPT from MCS: ref #1170543
2019-01-14 22:46:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170543  12 58497 81966865 A  ERRORB˜™š'
2019-01-14 22:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:46:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:46:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:46:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:46:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:46:09 [DEBUG   ] Finished updating board flags in 1.502 seconds
2019-01-14 22:46:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 22:46:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:47:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 22:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:47:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:47:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:47:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:47:09 [WARNING ] (13, 1, 'bot')
2019-01-14 22:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:47:09 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-14 22:47:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 22:47:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 22:48:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 22:48:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:48:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:48:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:48:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:48:10 [DEBUG   ] Finished updating board flags in 2.109 seconds
2019-01-14 22:48:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:48:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 22:49:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 22:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:49:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:49:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:49:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:49:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:49:10 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-14 22:49:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 22:49:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 22:50:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 22:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:50:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:50:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:50:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:50:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:50:10 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-01-14 22:50:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 22:50:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 22:51:04 [DEBUG   ] Got command RPT from MCS: ref #1170556
2019-01-14 22:51:04 [DEBUG   ] summary = ERROR
2019-01-14 22:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170556  13 58497 82264829 A  ERRORERROR'
2019-01-14 22:51:04 [DEBUG   ] Got command RPT from MCS: ref #1170557
2019-01-14 22:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170557  77 58497 82264830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:51:06 [DEBUG   ] Got command RPT from MCS: ref #1170573
2019-01-14 22:51:06 [DEBUG   ] summary = ERROR
2019-01-14 22:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170573  13 58497 82266149 A  ERRORERROR'
2019-01-14 22:51:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 22:51:06 [DEBUG   ] Got command RPT from MCS: ref #1170574
2019-01-14 22:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170574  77 58497 82266353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:51:06 [DEBUG   ] Got command RPT from MCS: ref #1170575
2019-01-14 22:51:06 [DEBUG   ] summary = ERROR
2019-01-14 22:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170575  13 58497 82266545 A  ERRORERROR'
2019-01-14 22:51:06 [DEBUG   ] Got command RPT from MCS: ref #1170576
2019-01-14 22:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170576  77 58497 82266749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:51:06 [DEBUG   ] Got command RPT from MCS: ref #1170577
2019-01-14 22:51:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170577  12 58497 82266953 A  ERRORB™™š'
2019-01-14 22:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:51:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 22:51:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:51:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:51:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:51:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:51:10 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-01-14 22:51:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 22:51:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 22:52:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 22:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:52:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:52:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:52:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:52:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:52:10 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-14 22:52:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 22:52:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 22:53:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 22:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:53:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 22:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 22:53:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:53:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:53:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:53:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:53:10 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-14 22:53:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 22:53:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 22:54:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 22:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 22:54:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:54:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:54:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:54:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:54:10 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-01-14 22:54:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:54:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:55:06 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-14 22:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:55:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 22:55:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:55:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:55:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:55:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:55:10 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-14 22:55:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 22:55:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 22:56:04 [DEBUG   ] Got command RPT from MCS: ref #1170584
2019-01-14 22:56:04 [DEBUG   ] summary = ERROR
2019-01-14 22:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170584  13 58497 82564837 A  ERRORERROR'
2019-01-14 22:56:04 [DEBUG   ] Got command RPT from MCS: ref #1170585
2019-01-14 22:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170585  77 58497 82564838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:56:06 [DEBUG   ] Got command RPT from MCS: ref #1170601
2019-01-14 22:56:06 [DEBUG   ] summary = ERROR
2019-01-14 22:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170601  13 58497 82566229 A  ERRORERROR'
2019-01-14 22:56:06 [DEBUG   ] Got command RPT from MCS: ref #1170602
2019-01-14 22:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170602  77 58497 82566433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:56:06 [DEBUG   ] Got command RPT from MCS: ref #1170603
2019-01-14 22:56:06 [DEBUG   ] summary = ERROR
2019-01-14 22:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170603  13 58497 82566625 A  ERRORERROR'
2019-01-14 22:56:06 [DEBUG   ] Got command RPT from MCS: ref #1170605
2019-01-14 22:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 22:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170605  77 58497 82566829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 22:56:07 [DEBUG   ] Got command RPT from MCS: ref #1170606
2019-01-14 22:56:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 22:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170606  12 58497 82567033 A  ERRORB™™š'
2019-01-14 22:56:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 22:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:56:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:56:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:56:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:56:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:56:10 [DEBUG   ] Finished updating board flags in 1.372 seconds
2019-01-14 22:56:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 22:56:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 22:57:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 22:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 22:57:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:57:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:57:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:57:10 [WARNING ] (13, 1, 'bot')
2019-01-14 22:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:57:10 [DEBUG   ] Finished updating board flags in 1.372 seconds
2019-01-14 22:57:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 22:57:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:58:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 22:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:58:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:58:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:58:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:58:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:58:11 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-01-14 22:58:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 22:58:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 22:59:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 22:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 22:59:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:59:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:59:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:59:11 [WARNING ] (13, 1, 'bot')
2019-01-14 22:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 22:59:11 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-14 22:59:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 22:59:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 23:00:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 23:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:00:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:00:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:00:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:00:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:00:11 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-01-14 23:00:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 23:00:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 23:01:04 [DEBUG   ] Got command RPT from MCS: ref #1170630
2019-01-14 23:01:04 [DEBUG   ] summary = ERROR
2019-01-14 23:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170630  13 58497 82864833 A  ERRORERROR'
2019-01-14 23:01:04 [DEBUG   ] Got command RPT from MCS: ref #1170631
2019-01-14 23:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170631  77 58497 82864834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:01:06 [DEBUG   ] Got command RPT from MCS: ref #1170647
2019-01-14 23:01:06 [DEBUG   ] summary = ERROR
2019-01-14 23:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170647  13 58497 82866309 A  ERRORERROR'
2019-01-14 23:01:06 [DEBUG   ] Got command RPT from MCS: ref #1170648
2019-01-14 23:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170648  77 58497 82866513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:01:06 [DEBUG   ] Got command RPT from MCS: ref #1170649
2019-01-14 23:01:06 [DEBUG   ] summary = ERROR
2019-01-14 23:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170649  13 58497 82866719 A  ERRORERROR'
2019-01-14 23:01:06 [DEBUG   ] Got command RPT from MCS: ref #1170650
2019-01-14 23:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170650  77 58497 82866909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:01:07 [DEBUG   ] Got command RPT from MCS: ref #1170651
2019-01-14 23:01:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170651  12 58497 82867113 A  ERRORB˜™š'
2019-01-14 23:01:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 23:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:01:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:01:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:01:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:01:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:01:11 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-14 23:01:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-14 23:01:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 23:02:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 23:02:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:02:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:02:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:02:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:02:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:02:11 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-14 23:02:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 23:02:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:03:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 23:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:03:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:03:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:03:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:03:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:03:11 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-14 23:03:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 23:03:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 23:04:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 23:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:04:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:04:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:04:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:04:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:04:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:04:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:04:11 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-14 23:04:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:04:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 23:05:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 23:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:05:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:05:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:05:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:05:11 [WARNING ] (13, 1, 'bot')
2019-01-14 23:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:05:11 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-14 23:05:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 23:05:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:06:04 [DEBUG   ] Got command RPT from MCS: ref #1170662
2019-01-14 23:06:04 [DEBUG   ] summary = ERROR
2019-01-14 23:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170662  13 58497 83164829 A  ERRORERROR'
2019-01-14 23:06:04 [DEBUG   ] Got command RPT from MCS: ref #1170663
2019-01-14 23:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170663  77 58497 83164830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:06:06 [DEBUG   ] Got command RPT from MCS: ref #1170679
2019-01-14 23:06:06 [DEBUG   ] summary = ERROR
2019-01-14 23:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170679  13 58497 83166389 A  ERRORERROR'
2019-01-14 23:06:06 [DEBUG   ] Got command RPT from MCS: ref #1170680
2019-01-14 23:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170680  77 58497 83166593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:06:06 [DEBUG   ] Got command RPT from MCS: ref #1170681
2019-01-14 23:06:06 [DEBUG   ] summary = ERROR
2019-01-14 23:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170681  13 58497 83166797 A  ERRORERROR'
2019-01-14 23:06:06 [DEBUG   ] Got command RPT from MCS: ref #1170683
2019-01-14 23:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170683  77 58497 83166989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:06:07 [DEBUG   ] Got command RPT from MCS: ref #1170685
2019-01-14 23:06:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:06:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170685  12 58497 83167193 A  ERRORB˜™š'
2019-01-14 23:06:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 23:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:06:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:06:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:06:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:06:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:06:12 [DEBUG   ] Finished updating board flags in 2.212 seconds
2019-01-14 23:06:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:06:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 23:07:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 23:07:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:07:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:07:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:07:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:07:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:07:12 [DEBUG   ] Finished updating board flags in 2.175 seconds
2019-01-14 23:07:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 23:07:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 23:08:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 23:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:08:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:08:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:08:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:08:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:08:12 [DEBUG   ] Finished updating board flags in 2.022 seconds
2019-01-14 23:08:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 23:08:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 23:09:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:09:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-14 23:09:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:09:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:09:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:09:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:09:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:09:12 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-01-14 23:09:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:09:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 23:10:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 23:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:10:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:10:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:10:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:10:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:10:12 [DEBUG   ] Finished updating board flags in 1.833 seconds
2019-01-14 23:10:29 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-14 23:10:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 23:11:04 [DEBUG   ] Got command RPT from MCS: ref #1170693
2019-01-14 23:11:04 [DEBUG   ] summary = ERROR
2019-01-14 23:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170693  13 58497 83464833 A  ERRORERROR'
2019-01-14 23:11:04 [DEBUG   ] Got command RPT from MCS: ref #1170694
2019-01-14 23:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170694  77 58497 83464834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:11:06 [DEBUG   ] Got command RPT from MCS: ref #1170710
2019-01-14 23:11:06 [DEBUG   ] summary = ERROR
2019-01-14 23:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170710  13 58497 83466477 A  ERRORERROR'
2019-01-14 23:11:06 [DEBUG   ] Got command RPT from MCS: ref #1170711
2019-01-14 23:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170711  77 58497 83466681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:11:06 [DEBUG   ] Got command RPT from MCS: ref #1170712
2019-01-14 23:11:06 [DEBUG   ] summary = ERROR
2019-01-14 23:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170712  13 58497 83466873 A  ERRORERROR'
2019-01-14 23:11:07 [DEBUG   ] Got command RPT from MCS: ref #1170713
2019-01-14 23:11:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170713  77 58497 83467077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:11:07 [DEBUG   ] Got command RPT from MCS: ref #1170714
2019-01-14 23:11:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170714  12 58497 83467281 A  ERRORB™™š'
2019-01-14 23:11:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 23:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:11:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:11:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:11:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:11:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:11:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:11:12 [DEBUG   ] Finished updating board flags in 1.763 seconds
2019-01-14 23:11:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:11:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 23:12:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-14 23:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:12:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:12:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:12:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:12:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:12:12 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-14 23:12:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-14 23:12:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 23:13:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 23:13:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:13:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:13:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:13:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:13:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:13:12 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-14 23:13:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 23:13:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-14 23:14:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 23:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:14:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:14:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:14:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:14:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:14:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:14:12 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-14 23:14:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 23:14:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 23:15:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-14 23:15:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:15:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:15:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:15:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:15:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:15:12 [WARNING ] (13, 1, 'bot')
2019-01-14 23:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:15:12 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-01-14 23:15:31 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-14 23:15:51 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2019-01-14 23:16:04 [DEBUG   ] Got command RPT from MCS: ref #1170725
2019-01-14 23:16:04 [DEBUG   ] summary = ERROR
2019-01-14 23:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170725  13 58497 83764841 A  ERRORERROR'
2019-01-14 23:16:04 [DEBUG   ] Got command RPT from MCS: ref #1170726
2019-01-14 23:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170726  77 58497 83764842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:16:06 [DEBUG   ] Got command RPT from MCS: ref #1170742
2019-01-14 23:16:06 [DEBUG   ] summary = ERROR
2019-01-14 23:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170742  13 58497 83766557 A  ERRORERROR'
2019-01-14 23:16:06 [DEBUG   ] Got command RPT from MCS: ref #1170743
2019-01-14 23:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170743  77 58497 83766761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:16:06 [DEBUG   ] Got command RPT from MCS: ref #1170744
2019-01-14 23:16:06 [DEBUG   ] summary = ERROR
2019-01-14 23:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170744  13 58497 83766953 A  ERRORERROR'
2019-01-14 23:16:07 [DEBUG   ] Got command RPT from MCS: ref #1170746
2019-01-14 23:16:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170746  77 58497 83767157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:16:07 [DEBUG   ] Got command RPT from MCS: ref #1170747
2019-01-14 23:16:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170747  12 58497 83767361 A  ERRORB™™š'
2019-01-14 23:16:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:16:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:16:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:16:13 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-01-14 23:16:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:16:51 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2019-01-14 23:17:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 23:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:17:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:17:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:17:13 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-14 23:17:32 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2019-01-14 23:17:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:18:11 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-14 23:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:18:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:18:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:18:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:18:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:18:13 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-14 23:18:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:18:52 [DEBUG   ] Finished updating ant stats in 1.378 seconds
2019-01-14 23:19:12 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2019-01-14 23:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:19:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 23:19:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:19:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:19:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:19:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:19:13 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-14 23:19:32 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-01-14 23:19:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:20:12 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2019-01-14 23:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:20:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:20:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:20:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:20:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:20:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:20:13 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-14 23:20:32 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-01-14 23:20:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 23:21:04 [DEBUG   ] Got command RPT from MCS: ref #1170760
2019-01-14 23:21:04 [DEBUG   ] summary = ERROR
2019-01-14 23:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170760  13 58497 84064833 A  ERRORERROR'
2019-01-14 23:21:04 [DEBUG   ] Got command RPT from MCS: ref #1170761
2019-01-14 23:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170761  77 58497 84064834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:21:06 [DEBUG   ] Got command RPT from MCS: ref #1170777
2019-01-14 23:21:06 [DEBUG   ] summary = ERROR
2019-01-14 23:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170777  13 58497 84066633 A  ERRORERROR'
2019-01-14 23:21:06 [DEBUG   ] Got command RPT from MCS: ref #1170778
2019-01-14 23:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170778  77 58497 84066837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:21:07 [DEBUG   ] Got command RPT from MCS: ref #1170779
2019-01-14 23:21:07 [DEBUG   ] summary = ERROR
2019-01-14 23:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170779  13 58497 84067041 A  ERRORERROR'
2019-01-14 23:21:07 [DEBUG   ] Got command RPT from MCS: ref #1170780
2019-01-14 23:21:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170780  77 58497 84067245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:21:07 [DEBUG   ] Got command RPT from MCS: ref #1170781
2019-01-14 23:21:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170781  12 58497 84067437 A  ERRORB˜™š'
2019-01-14 23:21:12 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-01-14 23:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:21:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:21:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:21:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:21:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:21:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:21:13 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-14 23:21:32 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2019-01-14 23:21:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 23:22:12 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-14 23:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:22:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:22:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:22:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:22:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:22:13 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-14 23:22:32 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2019-01-14 23:22:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 23:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:23:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 23:23:13 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-14 23:23:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:23:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:23:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:23:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:23:13 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-14 23:23:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 23:23:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 23:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:24:13 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2019-01-14 23:24:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:24:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:24:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:24:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:24:13 [DEBUG   ] Finished updating board flags in 1.448 seconds
2019-01-14 23:24:33 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-01-14 23:24:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:25:13 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-01-14 23:25:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:25:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:25:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:25:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:25:13 [DEBUG   ] Finished updating board flags in 1.460 seconds
2019-01-14 23:25:33 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2019-01-14 23:25:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:26:04 [DEBUG   ] Got command RPT from MCS: ref #1170788
2019-01-14 23:26:04 [DEBUG   ] summary = ERROR
2019-01-14 23:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170788  13 58497 84364837 A  ERRORERROR'
2019-01-14 23:26:04 [DEBUG   ] Got command RPT from MCS: ref #1170789
2019-01-14 23:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170789  77 58497 84364838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:26:06 [DEBUG   ] Got command RPT from MCS: ref #1170805
2019-01-14 23:26:06 [DEBUG   ] summary = ERROR
2019-01-14 23:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170805  13 58497 84366721 A  ERRORERROR'
2019-01-14 23:26:06 [DEBUG   ] Got command RPT from MCS: ref #1170806
2019-01-14 23:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170806  77 58497 84366913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:26:07 [DEBUG   ] Got command RPT from MCS: ref #1170807
2019-01-14 23:26:07 [DEBUG   ] summary = ERROR
2019-01-14 23:26:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170807  13 58497 84367117 A  ERRORERROR'
2019-01-14 23:26:07 [DEBUG   ] Got command RPT from MCS: ref #1170809
2019-01-14 23:26:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:26:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170809  77 58497 84367321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:26:07 [DEBUG   ] Got command RPT from MCS: ref #1170811
2019-01-14 23:26:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:26:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170811  12 58497 84367525 A  ERRORB—™š'
2019-01-14 23:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:26:13 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-01-14 23:26:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:26:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:26:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:26:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:26:13 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-14 23:26:33 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2019-01-14 23:26:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-14 23:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:27:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:27:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:27:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:27:13 [WARNING ] (13, 1, 'bot')
2019-01-14 23:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:27:13 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-14 23:27:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-14 23:27:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:27:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:28:14 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2019-01-14 23:28:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:28:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:28:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:28:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:28:14 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-01-14 23:28:34 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2019-01-14 23:28:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 23:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:29:14 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2019-01-14 23:29:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:29:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:29:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:29:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:29:14 [DEBUG   ] Finished updating board flags in 2.163 seconds
2019-01-14 23:29:34 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2019-01-14 23:29:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 23:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:30:14 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-01-14 23:30:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:30:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:30:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:30:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:30:14 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-14 23:30:34 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2019-01-14 23:30:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:31:04 [DEBUG   ] Got command RPT from MCS: ref #1170823
2019-01-14 23:31:04 [DEBUG   ] summary = ERROR
2019-01-14 23:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170823  13 58497 84664845 A  ERRORERROR'
2019-01-14 23:31:04 [DEBUG   ] Got command RPT from MCS: ref #1170824
2019-01-14 23:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170824  77 58497 84664846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:31:06 [DEBUG   ] Got command RPT from MCS: ref #1170840
2019-01-14 23:31:06 [DEBUG   ] summary = ERROR
2019-01-14 23:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170840  13 58497 84666801 A  ERRORERROR'
2019-01-14 23:31:07 [DEBUG   ] Got command RPT from MCS: ref #1170841
2019-01-14 23:31:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170841  77 58497 84667005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:31:07 [DEBUG   ] Got command RPT from MCS: ref #1170842
2019-01-14 23:31:07 [DEBUG   ] summary = ERROR
2019-01-14 23:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170842  13 58497 84667197 A  ERRORERROR'
2019-01-14 23:31:07 [DEBUG   ] Got command RPT from MCS: ref #1170843
2019-01-14 23:31:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170843  77 58497 84667401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:31:07 [DEBUG   ] Got command RPT from MCS: ref #1170844
2019-01-14 23:31:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170844  12 58497 84667605 A  ERRORB™™š'
2019-01-14 23:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:31:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:31:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:31:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:31:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:31:14 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-14 23:31:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-14 23:31:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 23:31:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 23:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:32:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:32:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:32:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:32:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:32:14 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-01-14 23:32:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 23:32:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:32:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 23:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 23:33:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:33:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:33:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:33:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:33:14 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-14 23:33:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:33:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:33:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 23:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:34:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:34:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:34:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:34:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:34:14 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-14 23:34:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 23:34:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:34:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:35:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:35:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:35:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:35:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:35:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:35:14 [DEBUG   ] Finished updating board flags in 1.728 seconds
2019-01-14 23:35:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 23:35:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 23:35:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 23:36:04 [DEBUG   ] Got command RPT from MCS: ref #1170855
2019-01-14 23:36:04 [DEBUG   ] summary = ERROR
2019-01-14 23:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170855  13 58497 84964841 A  ERRORERROR'
2019-01-14 23:36:04 [DEBUG   ] Got command RPT from MCS: ref #1170856
2019-01-14 23:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170856  77 58497 84964842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:36:06 [DEBUG   ] Got command RPT from MCS: ref #1170872
2019-01-14 23:36:06 [DEBUG   ] summary = ERROR
2019-01-14 23:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170872  13 58497 84966881 A  ERRORERROR'
2019-01-14 23:36:07 [DEBUG   ] Got command RPT from MCS: ref #1170873
2019-01-14 23:36:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170873  77 58497 84967085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:36:07 [DEBUG   ] Got command RPT from MCS: ref #1170874
2019-01-14 23:36:07 [DEBUG   ] summary = ERROR
2019-01-14 23:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170874  13 58497 84967277 A  ERRORERROR'
2019-01-14 23:36:07 [DEBUG   ] Got command RPT from MCS: ref #1170876
2019-01-14 23:36:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170876  77 58497 84967481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:36:07 [DEBUG   ] Got command RPT from MCS: ref #1170877
2019-01-14 23:36:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170877  12 58497 84967686 A  ERRORB™™š'
2019-01-14 23:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:36:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:36:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:36:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:36:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:36:14 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-14 23:36:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:36:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 23:36:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:37:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:37:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:37:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:37:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:37:14 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-14 23:37:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 23:37:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 23:37:56 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 23:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:38:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:38:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:38:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:38:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:38:14 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-01-14 23:38:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 23:38:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-14 23:38:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:39:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:39:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:39:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:39:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:39:14 [DEBUG   ] Finished updating board flags in 1.544 seconds
2019-01-14 23:39:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:39:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 23:39:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:40:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:40:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:40:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:40:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:40:14 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-14 23:40:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 23:40:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 23:40:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:41:04 [DEBUG   ] Got command RPT from MCS: ref #1170886
2019-01-14 23:41:04 [DEBUG   ] summary = ERROR
2019-01-14 23:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170886  13 58497 85264845 A  ERRORERROR'
2019-01-14 23:41:04 [DEBUG   ] Got command RPT from MCS: ref #1170887
2019-01-14 23:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170887  77 58497 85264846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:41:06 [DEBUG   ] Got command RPT from MCS: ref #1170903
2019-01-14 23:41:06 [DEBUG   ] summary = ERROR
2019-01-14 23:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170903  13 58497 85266957 A  ERRORERROR'
2019-01-14 23:41:07 [DEBUG   ] Got command RPT from MCS: ref #1170904
2019-01-14 23:41:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170904  77 58497 85267161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:41:07 [DEBUG   ] Got command RPT from MCS: ref #1170905
2019-01-14 23:41:07 [DEBUG   ] summary = ERROR
2019-01-14 23:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170905  13 58497 85267365 A  ERRORERROR'
2019-01-14 23:41:07 [DEBUG   ] Got command RPT from MCS: ref #1170906
2019-01-14 23:41:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170906  77 58497 85267557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:41:07 [DEBUG   ] Got command RPT from MCS: ref #1170907
2019-01-14 23:41:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170907  12 58497 85267761 A  ERRORB˜™š'
2019-01-14 23:41:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:41:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:41:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:41:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:41:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:41:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:41:14 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-01-14 23:41:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:41:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 23:41:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-14 23:42:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:42:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:42:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:42:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:42:14 [WARNING ] (13, 1, 'bot')
2019-01-14 23:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:42:14 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-14 23:42:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 23:42:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:42:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 23:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-14 23:43:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:43:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:43:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:43:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:43:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:43:15 [DEBUG   ] Finished updating board flags in 2.038 seconds
2019-01-14 23:43:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:43:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-14 23:43:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-14 23:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:44:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:44:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:44:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:44:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:44:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:44:15 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-14 23:44:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-14 23:44:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 23:44:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 23:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:45:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-14 23:45:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:45:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:45:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:45:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:45:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:45:15 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-14 23:45:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:45:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 23:45:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:46:04 [DEBUG   ] Got command RPT from MCS: ref #1170918
2019-01-14 23:46:04 [DEBUG   ] summary = ERROR
2019-01-14 23:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170918  13 58497 85564841 A  ERRORERROR'
2019-01-14 23:46:04 [DEBUG   ] Got command RPT from MCS: ref #1170919
2019-01-14 23:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170919  77 58497 85564842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:46:07 [DEBUG   ] Got command RPT from MCS: ref #1170935
2019-01-14 23:46:07 [DEBUG   ] summary = ERROR
2019-01-14 23:46:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170935  13 58497 85567037 A  ERRORERROR'
2019-01-14 23:46:07 [DEBUG   ] Got command RPT from MCS: ref #1170936
2019-01-14 23:46:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:46:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170936  77 58497 85567241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:46:07 [DEBUG   ] Got command RPT from MCS: ref #1170937
2019-01-14 23:46:07 [DEBUG   ] summary = ERROR
2019-01-14 23:46:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170937  13 58497 85567445 A  ERRORERROR'
2019-01-14 23:46:07 [DEBUG   ] Got command RPT from MCS: ref #1170939
2019-01-14 23:46:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:46:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170939  77 58497 85567649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:46:07 [DEBUG   ] Got command RPT from MCS: ref #1170940
2019-01-14 23:46:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:46:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170940  12 58497 85567841 A  ERRORB—™š'
2019-01-14 23:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:46:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:46:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:46:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:46:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:46:15 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-14 23:46:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 23:46:37 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-14 23:46:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 23:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:47:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:47:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:47:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:47:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:47:15 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-14 23:47:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:47:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 23:47:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 23:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:48:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:48:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:48:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:48:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:48:15 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-14 23:48:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 23:48:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:48:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-14 23:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:49:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:49:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:49:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:49:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:49:15 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-14 23:49:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 23:49:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:49:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 23:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:50:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:50:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:50:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:50:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:50:15 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-14 23:50:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 23:50:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-14 23:50:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 23:51:04 [DEBUG   ] Got command RPT from MCS: ref #1170953
2019-01-14 23:51:04 [DEBUG   ] summary = ERROR
2019-01-14 23:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170953  13 58497 85864849 A  ERRORERROR'
2019-01-14 23:51:04 [DEBUG   ] Got command RPT from MCS: ref #1170954
2019-01-14 23:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170954  77 58497 85864850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:51:07 [DEBUG   ] Got command RPT from MCS: ref #1170970
2019-01-14 23:51:07 [DEBUG   ] summary = ERROR
2019-01-14 23:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170970  13 58497 85867117 A  ERRORERROR'
2019-01-14 23:51:07 [DEBUG   ] Got command RPT from MCS: ref #1170971
2019-01-14 23:51:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170971  77 58497 85867321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:51:07 [DEBUG   ] Got command RPT from MCS: ref #1170972
2019-01-14 23:51:07 [DEBUG   ] summary = ERROR
2019-01-14 23:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170972  13 58497 85867525 A  ERRORERROR'
2019-01-14 23:51:07 [DEBUG   ] Got command RPT from MCS: ref #1170973
2019-01-14 23:51:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170973  77 58497 85867729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:51:07 [DEBUG   ] Got command RPT from MCS: ref #1170974
2019-01-14 23:51:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170974  12 58497 85867921 A  ERRORB™™š'
2019-01-14 23:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:51:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:51:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:51:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:51:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:51:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:51:15 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-14 23:51:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-14 23:51:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-14 23:51:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 23:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:52:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:52:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:52:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:52:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:52:15 [WARNING ] (13, 1, 'bot')
2019-01-14 23:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:52:15 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-01-14 23:52:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 23:52:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 23:52:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-14 23:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:53:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:53:16 [DEBUG   ] Finished updating board flags in 2.037 seconds
2019-01-14 23:53:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 23:53:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-14 23:53:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-14 23:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:54:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-14 23:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:54:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:54:16 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-14 23:54:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-14 23:54:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-14 23:54:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:55:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:55:16 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-14 23:55:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-14 23:55:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-14 23:55:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-14 23:56:04 [DEBUG   ] Got command RPT from MCS: ref #1170981
2019-01-14 23:56:04 [DEBUG   ] summary = ERROR
2019-01-14 23:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170981  13 58497 86164841 A  ERRORERROR'
2019-01-14 23:56:04 [DEBUG   ] Got command RPT from MCS: ref #1170982
2019-01-14 23:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170982  77 58497 86164842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:56:07 [DEBUG   ] Got command RPT from MCS: ref #1170998
2019-01-14 23:56:07 [DEBUG   ] summary = ERROR
2019-01-14 23:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170998  13 58497 86167205 A  ERRORERROR'
2019-01-14 23:56:07 [DEBUG   ] Got command RPT from MCS: ref #1170999
2019-01-14 23:56:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1170999  77 58497 86167409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:56:07 [DEBUG   ] Got command RPT from MCS: ref #1171000
2019-01-14 23:56:07 [DEBUG   ] summary = ERROR
2019-01-14 23:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171000  13 58497 86167601 A  ERRORERROR'
2019-01-14 23:56:07 [DEBUG   ] Got command RPT from MCS: ref #1171002
2019-01-14 23:56:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-14 23:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171002  77 58497 86167805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-14 23:56:08 [DEBUG   ] Got command RPT from MCS: ref #1171003
2019-01-14 23:56:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-14 23:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171003  12 58497 86168009 A  ERRORB™™š'
2019-01-14 23:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:56:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:56:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:56:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:56:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:56:16 [DEBUG   ] Finished updating board flags in 1.840 seconds
2019-01-14 23:56:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-14 23:56:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-14 23:56:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 23:57:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-14 23:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:57:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-14 23:57:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:57:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:57:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:57:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:57:16 [DEBUG   ] Finished updating board flags in 1.747 seconds
2019-01-14 23:57:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-14 23:57:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-14 23:57:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-14 23:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:58:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:58:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:58:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:58:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:58:16 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-14 23:58:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-14 23:58:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-14 23:58:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-14 23:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-14 23:59:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:59:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:59:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:59:16 [WARNING ] (13, 1, 'bot')
2019-01-14 23:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-14 23:59:16 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-14 23:59:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-14 23:59:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-14 23:59:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:00:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:00:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:00:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:00:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:00:16 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-15 00:00:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 00:00:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 00:00:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 00:01:04 [DEBUG   ] Got command RPT from MCS: ref #1171016
2019-01-15 00:01:04 [DEBUG   ] summary = ERROR
2019-01-15 00:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171016  13 58498    64849 A  ERRORERROR'
2019-01-15 00:01:04 [DEBUG   ] Got command RPT from MCS: ref #1171017
2019-01-15 00:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171017  77 58498    64850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:01:07 [DEBUG   ] Got command RPT from MCS: ref #1171033
2019-01-15 00:01:07 [DEBUG   ] summary = ERROR
2019-01-15 00:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171033  13 58498    67285 A  ERRORERROR'
2019-01-15 00:01:07 [DEBUG   ] Got command RPT from MCS: ref #1171034
2019-01-15 00:01:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171034  77 58498    67489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:01:07 [DEBUG   ] Got command RPT from MCS: ref #1171035
2019-01-15 00:01:07 [DEBUG   ] summary = ERROR
2019-01-15 00:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171035  13 58498    67681 A  ERRORERROR'
2019-01-15 00:01:07 [DEBUG   ] Got command RPT from MCS: ref #1171036
2019-01-15 00:01:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171036  77 58498    67885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:01:08 [DEBUG   ] Got command RPT from MCS: ref #1171037
2019-01-15 00:01:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:01:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171037  12 58498    68089 A  ERRORB˜™š'
2019-01-15 00:01:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:01:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:01:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:01:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:01:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:01:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:01:16 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-15 00:01:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 00:01:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 00:01:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 00:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:02:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:02:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:02:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:02:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:02:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:02:16 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-01-15 00:02:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 00:02:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 00:02:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 00:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:03:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:03:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:03:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:03:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:03:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:03:16 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-01-15 00:03:20 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2019-01-15 00:03:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 00:04:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 00:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:04:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:04:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:04:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:04:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:04:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:04:16 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-01-15 00:04:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 00:04:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 00:05:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:05:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-15 00:05:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:05:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:05:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:05:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:05:16 [WARNING ] (13, 1, 'bot')
2019-01-15 00:05:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:05:16 [DEBUG   ] Finished updating board flags in 1.477 seconds
2019-01-15 00:05:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 00:05:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 00:06:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:06:04 [DEBUG   ] Got command RPT from MCS: ref #1171048
2019-01-15 00:06:04 [DEBUG   ] summary = ERROR
2019-01-15 00:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171048  13 58498   364849 A  ERRORERROR'
2019-01-15 00:06:04 [DEBUG   ] Got command RPT from MCS: ref #1171049
2019-01-15 00:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171049  77 58498   364850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:06:07 [DEBUG   ] Got command RPT from MCS: ref #1171065
2019-01-15 00:06:07 [DEBUG   ] summary = ERROR
2019-01-15 00:06:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171065  13 58498   367369 A  ERRORERROR'
2019-01-15 00:06:07 [DEBUG   ] Got command RPT from MCS: ref #1171066
2019-01-15 00:06:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:06:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171066  77 58498   367561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:06:07 [DEBUG   ] Got command RPT from MCS: ref #1171067
2019-01-15 00:06:07 [DEBUG   ] summary = ERROR
2019-01-15 00:06:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171067  13 58498   367765 A  ERRORERROR'
2019-01-15 00:06:07 [DEBUG   ] Got command RPT from MCS: ref #1171069
2019-01-15 00:06:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:06:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171069  77 58498   367969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:06:08 [DEBUG   ] Got command RPT from MCS: ref #1171071
2019-01-15 00:06:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171071  12 58498   368173 A  ERRORB™™š'
2019-01-15 00:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:06:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:06:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:06:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:06:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:06:17 [DEBUG   ] Finished updating board flags in 2.247 seconds
2019-01-15 00:06:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 00:06:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 00:07:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 00:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:07:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:07:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:07:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:07:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:07:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:07:17 [DEBUG   ] Finished updating board flags in 2.139 seconds
2019-01-15 00:07:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 00:07:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 00:08:00 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 00:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:08:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 00:08:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:08:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:08:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:08:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:08:17 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-15 00:08:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 00:08:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 00:09:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:09:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:09:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:09:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:09:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:09:17 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-15 00:09:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 00:09:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:10:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 00:10:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:10:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:10:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:10:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:10:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:10:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:10:17 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-15 00:10:21 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-15 00:10:42 [DEBUG   ] Finished updating ant stats in 1.799 seconds
2019-01-15 00:11:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 00:11:04 [DEBUG   ] Got command RPT from MCS: ref #1171079
2019-01-15 00:11:04 [DEBUG   ] summary = ERROR
2019-01-15 00:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171079  13 58498   664849 A  ERRORERROR'
2019-01-15 00:11:04 [DEBUG   ] Got command RPT from MCS: ref #1171080
2019-01-15 00:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171080  77 58498   664850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:11:07 [DEBUG   ] Got command RPT from MCS: ref #1171096
2019-01-15 00:11:07 [DEBUG   ] summary = ERROR
2019-01-15 00:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171096  13 58498   667453 A  ERRORERROR'
2019-01-15 00:11:07 [DEBUG   ] Got command RPT from MCS: ref #1171097
2019-01-15 00:11:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171097  77 58498   667645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:11:07 [DEBUG   ] Got command RPT from MCS: ref #1171098
2019-01-15 00:11:07 [DEBUG   ] summary = ERROR
2019-01-15 00:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171098  13 58498   667849 A  ERRORERROR'
2019-01-15 00:11:08 [DEBUG   ] Got command RPT from MCS: ref #1171099
2019-01-15 00:11:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:11:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171099  77 58498   668053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:11:08 [DEBUG   ] Got command RPT from MCS: ref #1171100
2019-01-15 00:11:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:11:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171100  12 58498   668245 A  ERRORB˜™š'
2019-01-15 00:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:11:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:11:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:11:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:11:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:11:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:11:17 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 00:11:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:11:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 00:12:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 00:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:12:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:12:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:12:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:12:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:12:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:12:17 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-15 00:12:22 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 00:12:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:13:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 00:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:13:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:13:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:13:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:13:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:13:17 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-15 00:13:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 00:13:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 00:14:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 00:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:14:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:14:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:14:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:14:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:14:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:14:17 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-15 00:14:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 00:14:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:15:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 00:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:15:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:15:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:15:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:15:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:15:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:15:17 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 00:15:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 00:15:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 00:16:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 00:16:04 [DEBUG   ] Got command RPT from MCS: ref #1171111
2019-01-15 00:16:04 [DEBUG   ] summary = ERROR
2019-01-15 00:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171111  13 58498   964845 A  ERRORERROR'
2019-01-15 00:16:04 [DEBUG   ] Got command RPT from MCS: ref #1171112
2019-01-15 00:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171112  77 58498   964846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:16:07 [DEBUG   ] Got command RPT from MCS: ref #1171128
2019-01-15 00:16:07 [DEBUG   ] summary = ERROR
2019-01-15 00:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171128  13 58498   967533 A  ERRORERROR'
2019-01-15 00:16:07 [DEBUG   ] Got command RPT from MCS: ref #1171129
2019-01-15 00:16:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171129  77 58498   967725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:16:07 [DEBUG   ] Got command RPT from MCS: ref #1171130
2019-01-15 00:16:07 [DEBUG   ] summary = ERROR
2019-01-15 00:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171130  13 58498   967929 A  ERRORERROR'
2019-01-15 00:16:08 [DEBUG   ] Got command RPT from MCS: ref #1171132
2019-01-15 00:16:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:16:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171132  77 58498   968133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:16:08 [DEBUG   ] Got command RPT from MCS: ref #1171134
2019-01-15 00:16:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:16:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171134  12 58498   968337 A  ERRORB˜™š'
2019-01-15 00:16:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:16:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:16:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:16:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:16:17 [WARNING ] (13, 1, 'bot')
2019-01-15 00:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:16:17 [DEBUG   ] Finished updating board flags in 1.360 seconds
2019-01-15 00:16:23 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 00:16:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 00:17:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 00:17:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:17:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:17:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:17:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:17:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:17:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:17:18 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-01-15 00:17:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:17:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 00:18:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 00:18:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:18:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:18:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:18:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:18:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:18:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:18:18 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-15 00:18:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 00:18:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 00:19:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 00:19:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:19:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:19:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:19:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:19:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:19:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:19:18 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-01-15 00:19:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:19:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 00:20:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 00:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:20:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:20:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 00:20:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:20:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:20:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:20:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:20:18 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-15 00:20:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 00:20:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:21:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:21:04 [DEBUG   ] Got command RPT from MCS: ref #1171146
2019-01-15 00:21:04 [DEBUG   ] summary = ERROR
2019-01-15 00:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171146  13 58498  1264853 A  ERRORERROR'
2019-01-15 00:21:04 [DEBUG   ] Got command RPT from MCS: ref #1171147
2019-01-15 00:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171147  77 58498  1264854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:21:07 [DEBUG   ] Got command RPT from MCS: ref #1171163
2019-01-15 00:21:07 [DEBUG   ] summary = ERROR
2019-01-15 00:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171163  13 58498  1267613 A  ERRORERROR'
2019-01-15 00:21:07 [DEBUG   ] Got command RPT from MCS: ref #1171164
2019-01-15 00:21:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171164  77 58498  1267805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:21:08 [DEBUG   ] Got command RPT from MCS: ref #1171165
2019-01-15 00:21:08 [DEBUG   ] summary = ERROR
2019-01-15 00:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171165  13 58498  1268009 A  ERRORERROR'
2019-01-15 00:21:08 [DEBUG   ] Got command RPT from MCS: ref #1171166
2019-01-15 00:21:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171166  77 58498  1268213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:21:08 [DEBUG   ] Got command RPT from MCS: ref #1171167
2019-01-15 00:21:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171167  12 58498  1268417 A  ERRORB—™š'
2019-01-15 00:21:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:21:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:21:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:21:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:21:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:21:18 [DEBUG   ] Finished updating board flags in 1.768 seconds
2019-01-15 00:21:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 00:21:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 00:22:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 00:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:22:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:22:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:22:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:22:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:22:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:22:18 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-01-15 00:22:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 00:22:43 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2019-01-15 00:23:04 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 00:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:23:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:23:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:23:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:23:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:23:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:23:18 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-01-15 00:23:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 00:23:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:24:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:24:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:24:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:24:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:24:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:24:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:24:18 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 00:24:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 00:24:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 00:25:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:25:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:25:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:25:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:25:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:25:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:25:18 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-01-15 00:25:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 00:25:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 00:26:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:26:04 [DEBUG   ] Got command RPT from MCS: ref #1171174
2019-01-15 00:26:04 [DEBUG   ] summary = ERROR
2019-01-15 00:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171174  13 58498  1564857 A  ERRORERROR'
2019-01-15 00:26:04 [DEBUG   ] Got command RPT from MCS: ref #1171175
2019-01-15 00:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171175  77 58498  1564858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:26:07 [DEBUG   ] Got command RPT from MCS: ref #1171191
2019-01-15 00:26:07 [DEBUG   ] summary = ERROR
2019-01-15 00:26:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171191  13 58498  1567689 A  ERRORERROR'
2019-01-15 00:26:07 [DEBUG   ] Got command RPT from MCS: ref #1171192
2019-01-15 00:26:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:26:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171192  77 58498  1567893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:26:08 [DEBUG   ] Got command RPT from MCS: ref #1171193
2019-01-15 00:26:08 [DEBUG   ] summary = ERROR
2019-01-15 00:26:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171193  13 58498  1568085 A  ERRORERROR'
2019-01-15 00:26:08 [DEBUG   ] Got command RPT from MCS: ref #1171195
2019-01-15 00:26:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:26:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171195  77 58498  1568289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:26:08 [DEBUG   ] Got command RPT from MCS: ref #1171196
2019-01-15 00:26:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:26:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171196  12 58498  1568493 A  ERRORB˜™š'
2019-01-15 00:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:26:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:26:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:26:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:26:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:26:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:26:18 [DEBUG   ] Finished updating board flags in 1.451 seconds
2019-01-15 00:26:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 00:26:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 00:27:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:27:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:27:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:27:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:27:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:27:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:27:18 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-01-15 00:27:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 00:27:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 00:28:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 00:28:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:28:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:28:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:28:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:28:18 [WARNING ] (13, 1, 'bot')
2019-01-15 00:28:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:28:18 [DEBUG   ] Finished updating board flags in 1.485 seconds
2019-01-15 00:28:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:28:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:29:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 00:29:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:29:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:29:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:29:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:29:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:29:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:29:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:29:19 [DEBUG   ] Finished updating board flags in 2.222 seconds
2019-01-15 00:29:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 00:29:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 00:30:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 00:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:30:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:30:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:30:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:30:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:30:19 [DEBUG   ] Finished updating board flags in 2.158 seconds
2019-01-15 00:30:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 00:30:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:31:04 [DEBUG   ] Got command RPT from MCS: ref #1171209
2019-01-15 00:31:04 [DEBUG   ] summary = ERROR
2019-01-15 00:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171209  13 58498  1864857 A  ERRORERROR'
2019-01-15 00:31:04 [DEBUG   ] Got command RPT from MCS: ref #1171210
2019-01-15 00:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171210  77 58498  1864858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:31:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:31:07 [DEBUG   ] Got command RPT from MCS: ref #1171226
2019-01-15 00:31:07 [DEBUG   ] summary = ERROR
2019-01-15 00:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171226  13 58498  1867773 A  ERRORERROR'
2019-01-15 00:31:07 [DEBUG   ] Got command RPT from MCS: ref #1171227
2019-01-15 00:31:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171227  77 58498  1867977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:31:08 [DEBUG   ] Got command RPT from MCS: ref #1171228
2019-01-15 00:31:08 [DEBUG   ] summary = ERROR
2019-01-15 00:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171228  13 58498  1868169 A  ERRORERROR'
2019-01-15 00:31:08 [DEBUG   ] Got command RPT from MCS: ref #1171229
2019-01-15 00:31:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171229  77 58498  1868373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:31:08 [DEBUG   ] Got command RPT from MCS: ref #1171230
2019-01-15 00:31:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171230  12 58498  1868577 A  ERRORB˜™š'
2019-01-15 00:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:31:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:31:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:31:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:31:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:31:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:31:19 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 00:31:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 00:31:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 00:32:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:32:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:32:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:32:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:32:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:32:19 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-15 00:32:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 00:32:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 00:33:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 00:33:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:33:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:33:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:33:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:33:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:33:19 [DEBUG   ] Finished updating board flags in 1.665 seconds
2019-01-15 00:33:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 00:33:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 00:34:05 [DEBUG   ] Finished updating ant stats in 0.561 seconds
2019-01-15 00:34:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:34:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:34:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:34:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:34:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:34:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:34:19 [DEBUG   ] Finished updating board flags in 1.556 seconds
2019-01-15 00:34:26 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2019-01-15 00:34:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 00:35:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:35:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 00:35:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:35:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:35:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:35:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:35:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:35:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:35:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:35:19 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-15 00:35:26 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-15 00:35:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:36:04 [DEBUG   ] Got command RPT from MCS: ref #1171241
2019-01-15 00:36:04 [DEBUG   ] summary = ERROR
2019-01-15 00:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171241  13 58498  2164861 A  ERRORERROR'
2019-01-15 00:36:04 [DEBUG   ] Got command RPT from MCS: ref #1171242
2019-01-15 00:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171242  77 58498  2164862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:36:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 00:36:07 [DEBUG   ] Got command RPT from MCS: ref #1171258
2019-01-15 00:36:07 [DEBUG   ] summary = ERROR
2019-01-15 00:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171258  13 58498  2167849 A  ERRORERROR'
2019-01-15 00:36:08 [DEBUG   ] Got command RPT from MCS: ref #1171259
2019-01-15 00:36:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:36:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171259  77 58498  2168053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:36:08 [DEBUG   ] Got command RPT from MCS: ref #1171260
2019-01-15 00:36:08 [DEBUG   ] summary = ERROR
2019-01-15 00:36:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171260  13 58498  2168257 A  ERRORERROR'
2019-01-15 00:36:08 [DEBUG   ] Got command RPT from MCS: ref #1171262
2019-01-15 00:36:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:36:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171262  77 58498  2168449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:36:08 [DEBUG   ] Got command RPT from MCS: ref #1171264
2019-01-15 00:36:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:36:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171264  12 58498  2168653 A  ERRORB˜™š'
2019-01-15 00:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:36:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:36:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:36:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:36:19 [WARNING ] (13, 1, 'bot')
2019-01-15 00:36:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:36:19 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-01-15 00:36:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 00:36:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 00:37:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 00:37:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:37:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:37:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:37:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:37:20 [DEBUG   ] Finished updating board flags in 2.043 seconds
2019-01-15 00:37:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 00:37:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 00:38:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 00:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:38:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:38:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:38:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:38:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:38:20 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-15 00:38:27 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 00:38:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 00:39:07 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 00:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 00:39:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:39:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:39:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:39:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:39:20 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-15 00:39:27 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-01-15 00:39:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 00:40:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 00:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:40:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:40:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:40:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:40:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:40:20 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-15 00:40:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 00:40:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 00:41:04 [DEBUG   ] Got command RPT from MCS: ref #1171272
2019-01-15 00:41:04 [DEBUG   ] summary = ERROR
2019-01-15 00:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171272  13 58498  2464853 A  ERRORERROR'
2019-01-15 00:41:04 [DEBUG   ] Got command RPT from MCS: ref #1171273
2019-01-15 00:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171273  77 58498  2464854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:41:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 00:41:07 [DEBUG   ] Got command RPT from MCS: ref #1171289
2019-01-15 00:41:07 [DEBUG   ] summary = ERROR
2019-01-15 00:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171289  13 58498  2467929 A  ERRORERROR'
2019-01-15 00:41:08 [DEBUG   ] Got command RPT from MCS: ref #1171290
2019-01-15 00:41:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171290  77 58498  2468133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:41:08 [DEBUG   ] Got command RPT from MCS: ref #1171291
2019-01-15 00:41:08 [DEBUG   ] summary = ERROR
2019-01-15 00:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171291  13 58498  2468337 A  ERRORERROR'
2019-01-15 00:41:08 [DEBUG   ] Got command RPT from MCS: ref #1171292
2019-01-15 00:41:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171292  77 58498  2468529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:41:08 [DEBUG   ] Got command RPT from MCS: ref #1171293
2019-01-15 00:41:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171293  12 58498  2468733 A  ERRORB˜™š'
2019-01-15 00:41:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-15 00:41:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:41:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:41:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:41:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:41:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:41:20 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 00:41:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 00:41:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 00:42:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:42:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:42:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:42:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:42:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:42:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:42:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:42:20 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 00:42:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 00:42:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 00:43:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 00:43:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:43:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:43:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:43:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:43:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:43:20 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 00:43:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 00:43:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 00:44:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 00:44:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:44:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:44:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:44:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:44:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:44:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:44:20 [DEBUG   ] Finished updating board flags in 1.654 seconds
2019-01-15 00:44:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 00:44:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 00:45:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 00:45:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:45:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:45:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:45:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:45:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:45:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:45:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:45:20 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-01-15 00:45:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 00:45:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 00:46:00 [DEBUG   ] Got command TBN from MCS: ref #1171304
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-15 00:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1171304   8 58498  2760357 A  ERROR'
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547513161']
2019-01-15 00:46:00 [DEBUG   ] spawn_process: at 2019-01-15 00:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547513161']
2019-01-15 00:46:00 [INFO    ] Finished spawning TBN in 0.054 s
2019-01-15 00:46:04 [DEBUG   ] Got command RPT from MCS: ref #1171305
2019-01-15 00:46:04 [DEBUG   ] summary = ERROR
2019-01-15 00:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171305  13 58498  2764857 A  ERRORERROR'
2019-01-15 00:46:04 [DEBUG   ] Got command RPT from MCS: ref #1171306
2019-01-15 00:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171306  77 58498  2764858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:46:08 [DEBUG   ] Got command RPT from MCS: ref #1171322
2019-01-15 00:46:08 [DEBUG   ] summary = ERROR
2019-01-15 00:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171322  13 58498  2768017 A  ERRORERROR'
2019-01-15 00:46:08 [DEBUG   ] Got command RPT from MCS: ref #1171323
2019-01-15 00:46:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171323  77 58498  2768209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:46:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 00:46:08 [DEBUG   ] Got command RPT from MCS: ref #1171324
2019-01-15 00:46:08 [DEBUG   ] summary = ERROR
2019-01-15 00:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171324  13 58498  2768413 A  ERRORERROR'
2019-01-15 00:46:08 [DEBUG   ] Got command RPT from MCS: ref #1171326
2019-01-15 00:46:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171326  77 58498  2768617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:46:08 [DEBUG   ] Got command RPT from MCS: ref #1171328
2019-01-15 00:46:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171328  12 58498  2768821 A  ERRORB˜™š'
2019-01-15 00:46:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:46:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:46:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:46:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:46:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:46:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:46:20 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-01-15 00:46:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 00:46:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:47:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 00:47:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:47:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:47:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:47:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:47:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:47:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:47:20 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-15 00:47:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 00:47:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 00:48:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 00:48:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:48:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:48:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:48:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:48:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:48:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:48:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:48:20 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-01-15 00:48:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 00:48:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 00:49:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 00:49:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:49:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:49:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:49:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:49:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:49:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:49:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:49:20 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-15 00:49:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 00:49:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 00:50:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 00:50:11 [DEBUG   ] Got command TBW from MCS: ref #1171337
2019-01-15 00:50:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-15 00:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1171337   8 58498  3011438 A  ERROR'
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-15 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-15 00:50:14 [DEBUG   ] spawn_process: at 2019-01-15 00:50:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-15 00:50:14 [INFO    ] Finished spawning TBW
2019-01-15 00:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:50:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:50:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:50:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:50:20 [WARNING ] (13, 1, 'bot')
2019-01-15 00:50:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:50:20 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-01-15 00:51:04 [DEBUG   ] Got command RPT from MCS: ref #1171344
2019-01-15 00:51:04 [DEBUG   ] summary = ERROR
2019-01-15 00:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171344  13 58498  3064861 A  ERRORERROR'
2019-01-15 00:51:04 [DEBUG   ] Got command RPT from MCS: ref #1171345
2019-01-15 00:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171345  77 58498  3064862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:51:08 [DEBUG   ] Got command RPT from MCS: ref #1171361
2019-01-15 00:51:08 [DEBUG   ] summary = ERROR
2019-01-15 00:51:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171361  13 58498  3068089 A  ERRORERROR'
2019-01-15 00:51:08 [DEBUG   ] Got command RPT from MCS: ref #1171362
2019-01-15 00:51:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:51:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171362  77 58498  3068293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:51:08 [DEBUG   ] Got command RPT from MCS: ref #1171363
2019-01-15 00:51:08 [DEBUG   ] summary = ERROR
2019-01-15 00:51:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171363  13 58498  3068497 A  ERRORERROR'
2019-01-15 00:51:08 [DEBUG   ] Got command RPT from MCS: ref #1171364
2019-01-15 00:51:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:51:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171364  77 58498  3068701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:51:08 [DEBUG   ] Got command RPT from MCS: ref #1171365
2019-01-15 00:51:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:51:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171365  12 58498  3068893 A  ERRORB˜™š'
2019-01-15 00:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:51:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:51:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:51:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:51:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:51:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:51:21 [DEBUG   ] Finished updating board flags in 2.154 seconds
2019-01-15 00:52:02 [INFO    ] __waitForTBW - TBW finished in 107.916 s
2019-01-15 00:52:03 [DEBUG   ] Finished updating ant stats in 0.412 seconds
2019-01-15 00:52:03 [INFO    ] Started antennas statistics background thread
2019-01-15 00:52:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547513525']
2019-01-15 00:52:03 [DEBUG   ] spawn_process: at 2019-01-15 00:52:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547513525']
2019-01-15 00:52:03 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-15 00:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:52:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 00:52:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-15 00:52:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:52:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:52:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:52:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:52:21 [DEBUG   ] Finished updating board flags in 2.190 seconds
2019-01-15 00:52:23 [DEBUG   ] Finished updating ant stats in 0.471 seconds
2019-01-15 00:52:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 00:53:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 00:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:53:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:53:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:53:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:53:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:53:21 [DEBUG   ] Finished updating board flags in 1.853 seconds
2019-01-15 00:53:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 00:53:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 00:54:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 00:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:54:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 00:54:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:54:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:54:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:54:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:54:21 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-15 00:54:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 00:54:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 00:55:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:55:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:55:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-15 00:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:55:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:55:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:55:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:55:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:55:21 [DEBUG   ] Finished updating board flags in 1.770 seconds
2019-01-15 00:55:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 00:55:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 00:56:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 00:56:04 [DEBUG   ] Got command RPT from MCS: ref #1171377
2019-01-15 00:56:04 [DEBUG   ] summary = ERROR
2019-01-15 00:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171377  13 58498  3364861 A  ERRORERROR'
2019-01-15 00:56:04 [DEBUG   ] Got command RPT from MCS: ref #1171378
2019-01-15 00:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171378  77 58498  3364862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:56:08 [DEBUG   ] Got command RPT from MCS: ref #1171394
2019-01-15 00:56:08 [DEBUG   ] summary = ERROR
2019-01-15 00:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171394  13 58498  3368173 A  ERRORERROR'
2019-01-15 00:56:08 [DEBUG   ] Got command RPT from MCS: ref #1171395
2019-01-15 00:56:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171395  77 58498  3368377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:56:08 [DEBUG   ] Got command RPT from MCS: ref #1171396
2019-01-15 00:56:08 [DEBUG   ] summary = ERROR
2019-01-15 00:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171396  13 58498  3368581 A  ERRORERROR'
2019-01-15 00:56:08 [DEBUG   ] Got command RPT from MCS: ref #1171398
2019-01-15 00:56:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 00:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171398  77 58498  3368785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 00:56:08 [DEBUG   ] Got command RPT from MCS: ref #1171399
2019-01-15 00:56:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 00:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171399  12 58498  3368977 A  ERRORB™™š'
2019-01-15 00:56:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:56:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:56:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:56:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:56:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:56:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:56:21 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-15 00:56:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 00:56:44 [DEBUG   ] Finished updating ant stats in 0.728 seconds
2019-01-15 00:57:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 00:57:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:57:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:57:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:57:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:57:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:57:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:57:21 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-01-15 00:57:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 00:57:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 00:58:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 00:58:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:58:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:58:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:58:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:58:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:58:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:58:21 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 00:58:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 00:58:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 00:59:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 00:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 00:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 00:59:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:59:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:59:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:59:21 [WARNING ] (13, 1, 'bot')
2019-01-15 00:59:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 00:59:21 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-15 00:59:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 00:59:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:00:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:00:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:00:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:00:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:00:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:00:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:00:22 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-15 01:00:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 01:00:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 01:01:04 [DEBUG   ] Got command RPT from MCS: ref #1171412
2019-01-15 01:01:04 [DEBUG   ] summary = ERROR
2019-01-15 01:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171412  13 58498  3664861 A  ERRORERROR'
2019-01-15 01:01:04 [DEBUG   ] Got command RPT from MCS: ref #1171413
2019-01-15 01:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171413  77 58498  3664862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:01:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:01:08 [DEBUG   ] Got command RPT from MCS: ref #1171429
2019-01-15 01:01:08 [DEBUG   ] summary = ERROR
2019-01-15 01:01:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171429  13 58498  3668257 A  ERRORERROR'
2019-01-15 01:01:08 [DEBUG   ] Got command RPT from MCS: ref #1171430
2019-01-15 01:01:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:01:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171430  77 58498  3668461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:01:08 [DEBUG   ] Got command RPT from MCS: ref #1171431
2019-01-15 01:01:08 [DEBUG   ] summary = ERROR
2019-01-15 01:01:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171431  13 58498  3668665 A  ERRORERROR'
2019-01-15 01:01:08 [DEBUG   ] Got command RPT from MCS: ref #1171432
2019-01-15 01:01:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:01:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171432  77 58498  3668857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:01:09 [DEBUG   ] Got command RPT from MCS: ref #1171433
2019-01-15 01:01:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171433  12 58498  3669061 A  ERRORB˜™š'
2019-01-15 01:01:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 01:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:01:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:01:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:01:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:01:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:01:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:01:22 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-15 01:01:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 01:01:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 01:02:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 01:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:02:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 01:02:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:02:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:02:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:02:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:02:22 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-15 01:02:26 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 01:02:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 01:03:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 01:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:03:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 01:03:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:03:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:03:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:03:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:03:22 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-15 01:03:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:03:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 01:04:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 01:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:04:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:04:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:04:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:04:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:04:22 [DEBUG   ] Finished updating board flags in 1.964 seconds
2019-01-15 01:04:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:04:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:05:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 01:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:05:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:05:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:05:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:05:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:05:22 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-01-15 01:05:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 01:05:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:06:04 [DEBUG   ] Got command RPT from MCS: ref #1171449
2019-01-15 01:06:04 [DEBUG   ] summary = ERROR
2019-01-15 01:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171449  13 58498  3964857 A  ERRORERROR'
2019-01-15 01:06:04 [DEBUG   ] Got command RPT from MCS: ref #1171450
2019-01-15 01:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171450  77 58498  3964858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:06:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:06:08 [DEBUG   ] Got command RPT from MCS: ref #1171466
2019-01-15 01:06:08 [DEBUG   ] summary = ERROR
2019-01-15 01:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171466  13 58498  3968337 A  ERRORERROR'
2019-01-15 01:06:08 [DEBUG   ] Got command RPT from MCS: ref #1171467
2019-01-15 01:06:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171467  77 58498  3968541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:06:08 [DEBUG   ] Got command RPT from MCS: ref #1171468
2019-01-15 01:06:08 [DEBUG   ] summary = ERROR
2019-01-15 01:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171468  13 58498  3968745 A  ERRORERROR'
2019-01-15 01:06:08 [DEBUG   ] Got command RPT from MCS: ref #1171470
2019-01-15 01:06:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171470  77 58498  3968937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:06:09 [DEBUG   ] Got command RPT from MCS: ref #1171472
2019-01-15 01:06:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:06:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171472  12 58498  3969141 A  ERRORB™™š'
2019-01-15 01:06:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 01:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:06:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:06:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:06:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:06:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:06:22 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-01-15 01:06:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 01:06:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 01:07:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:07:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 01:07:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-15 01:07:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:07:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:07:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:07:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:07:22 [WARNING ] (25, 5, 'bot')
2019-01-15 01:07:22 [WARNING ] (25, 5, 'bot')
2019-01-15 01:07:22 [WARNING ] (25, 5, 'bot')
2019-01-15 01:07:22 [WARNING ] (25, 5, 'bot')
2019-01-15 01:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:07:22 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-01-15 01:07:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 01:07:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:08:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 01:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:08:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:08:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:08:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:08:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:08:22 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-15 01:08:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:08:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 01:09:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 01:09:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:09:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:09:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:09:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:09:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:09:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:09:22 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-15 01:09:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 01:09:47 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 01:10:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 01:10:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:10:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 01:10:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:10:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:10:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:10:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:10:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:10:22 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-15 01:10:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 01:10:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 01:11:04 [DEBUG   ] Got command RPT from MCS: ref #1171485
2019-01-15 01:11:04 [DEBUG   ] summary = ERROR
2019-01-15 01:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171485  13 58498  4264865 A  ERRORERROR'
2019-01-15 01:11:04 [DEBUG   ] Got command RPT from MCS: ref #1171486
2019-01-15 01:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171486  77 58498  4264866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:11:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:11:08 [DEBUG   ] Got command RPT from MCS: ref #1171502
2019-01-15 01:11:08 [DEBUG   ] summary = ERROR
2019-01-15 01:11:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171502  13 58498  4268417 A  ERRORERROR'
2019-01-15 01:11:08 [DEBUG   ] Got command RPT from MCS: ref #1171503
2019-01-15 01:11:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:11:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171503  77 58498  4268621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:11:08 [DEBUG   ] Got command RPT from MCS: ref #1171504
2019-01-15 01:11:08 [DEBUG   ] summary = ERROR
2019-01-15 01:11:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171504  13 58498  4268825 A  ERRORERROR'
2019-01-15 01:11:09 [DEBUG   ] Got command RPT from MCS: ref #1171505
2019-01-15 01:11:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:11:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171505  77 58498  4269029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:11:09 [DEBUG   ] Got command RPT from MCS: ref #1171506
2019-01-15 01:11:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:11:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171506  12 58498  4269221 A  ERRORB™™š'
2019-01-15 01:11:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:11:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:11:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:11:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:11:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:11:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:11:22 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-15 01:11:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 01:11:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:12:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 01:12:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:12:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:12:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:12:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:12:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:12:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:12:22 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-15 01:12:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:12:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 01:13:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 01:13:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:13:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:13:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:13:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:13:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:13:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:13:22 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-15 01:13:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:13:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:14:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 01:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:14:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:14:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:14:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:14:22 [WARNING ] (13, 1, 'bot')
2019-01-15 01:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:14:22 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-15 01:14:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 01:14:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 01:15:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 01:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:15:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:15:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:15:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:15:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:15:23 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-01-15 01:15:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:15:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 01:16:04 [DEBUG   ] Got command RPT from MCS: ref #1171517
2019-01-15 01:16:04 [DEBUG   ] summary = ERROR
2019-01-15 01:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171517  13 58498  4564861 A  ERRORERROR'
2019-01-15 01:16:04 [DEBUG   ] Got command RPT from MCS: ref #1171518
2019-01-15 01:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171518  77 58498  4564862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:16:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:16:08 [DEBUG   ] Got command RPT from MCS: ref #1171534
2019-01-15 01:16:08 [DEBUG   ] summary = ERROR
2019-01-15 01:16:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171534  13 58498  4568497 A  ERRORERROR'
2019-01-15 01:16:08 [DEBUG   ] Got command RPT from MCS: ref #1171535
2019-01-15 01:16:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:16:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171535  77 58498  4568701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:16:08 [DEBUG   ] Got command RPT from MCS: ref #1171536
2019-01-15 01:16:08 [DEBUG   ] summary = ERROR
2019-01-15 01:16:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171536  13 58498  4568905 A  ERRORERROR'
2019-01-15 01:16:09 [DEBUG   ] Got command RPT from MCS: ref #1171538
2019-01-15 01:16:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171538  77 58498  4569109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:16:09 [DEBUG   ] Got command RPT from MCS: ref #1171540
2019-01-15 01:16:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171540  12 58498  4569301 A  ERRORB˜™š'
2019-01-15 01:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:16:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:16:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:16:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:16:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:16:23 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-01-15 01:16:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:16:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 01:17:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 01:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:17:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:17:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:17:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:17:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:17:23 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-15 01:17:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 01:17:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 01:18:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 01:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:18:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:18:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:18:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:18:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:18:23 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-15 01:18:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 01:18:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:19:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 01:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:19:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:19:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:19:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:19:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:19:23 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-15 01:19:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 01:19:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:20:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:20:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:20:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:20:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:20:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:20:23 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 01:20:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:20:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 01:21:04 [DEBUG   ] Got command RPT from MCS: ref #1171552
2019-01-15 01:21:04 [DEBUG   ] summary = ERROR
2019-01-15 01:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171552  13 58498  4864861 A  ERRORERROR'
2019-01-15 01:21:04 [DEBUG   ] Got command RPT from MCS: ref #1171553
2019-01-15 01:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171553  77 58498  4864862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:21:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:21:08 [DEBUG   ] Got command RPT from MCS: ref #1171569
2019-01-15 01:21:08 [DEBUG   ] summary = ERROR
2019-01-15 01:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171569  13 58498  4868581 A  ERRORERROR'
2019-01-15 01:21:08 [DEBUG   ] Got command RPT from MCS: ref #1171570
2019-01-15 01:21:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171570  77 58498  4868785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:21:08 [DEBUG   ] Got command RPT from MCS: ref #1171571
2019-01-15 01:21:08 [DEBUG   ] summary = ERROR
2019-01-15 01:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171571  13 58498  4868989 A  ERRORERROR'
2019-01-15 01:21:09 [DEBUG   ] Got command RPT from MCS: ref #1171572
2019-01-15 01:21:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171572  77 58498  4869181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:21:09 [DEBUG   ] Got command RPT from MCS: ref #1171573
2019-01-15 01:21:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171573  12 58498  4869385 A  ERRORB˜™š'
2019-01-15 01:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:21:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 01:21:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:21:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:21:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:21:23 [WARNING ] (13, 1, 'bot')
2019-01-15 01:21:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:21:23 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-15 01:21:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:21:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 01:22:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 01:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:22:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 01:22:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:22:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:22:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:22:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:22:24 [DEBUG   ] Finished updating board flags in 2.120 seconds
2019-01-15 01:22:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:22:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:23:08 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 01:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:23:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:23:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:23:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:23:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:23:24 [DEBUG   ] Finished updating board flags in 1.939 seconds
2019-01-15 01:23:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 01:23:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 01:24:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 01:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:24:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:24:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:24:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:24:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:24:24 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-15 01:24:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 01:24:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 01:25:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 01:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:25:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:25:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:25:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:25:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:25:24 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 01:25:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 01:25:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 01:26:04 [DEBUG   ] Got command RPT from MCS: ref #1171580
2019-01-15 01:26:04 [DEBUG   ] summary = ERROR
2019-01-15 01:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171580  13 58498  5164869 A  ERRORERROR'
2019-01-15 01:26:04 [DEBUG   ] Got command RPT from MCS: ref #1171581
2019-01-15 01:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171581  77 58498  5164870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:26:08 [DEBUG   ] Got command RPT from MCS: ref #1171597
2019-01-15 01:26:08 [DEBUG   ] summary = ERROR
2019-01-15 01:26:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171597  13 58498  5168665 A  ERRORERROR'
2019-01-15 01:26:08 [DEBUG   ] Got command RPT from MCS: ref #1171598
2019-01-15 01:26:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:26:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171598  77 58498  5168869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:26:09 [DEBUG   ] Got command RPT from MCS: ref #1171599
2019-01-15 01:26:09 [DEBUG   ] summary = ERROR
2019-01-15 01:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171599  13 58498  5169061 A  ERRORERROR'
2019-01-15 01:26:09 [DEBUG   ] Got command RPT from MCS: ref #1171601
2019-01-15 01:26:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171601  77 58498  5169265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:26:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:26:09 [DEBUG   ] Got command RPT from MCS: ref #1171603
2019-01-15 01:26:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171603  12 58498  5169469 A  ERRORB—™š'
2019-01-15 01:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:26:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:26:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:26:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:26:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:26:24 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-15 01:26:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:26:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:27:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 01:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:27:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:27:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:27:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:27:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:27:24 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-15 01:27:29 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-15 01:27:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 01:28:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 01:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:28:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:28:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:28:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:28:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:28:24 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-15 01:28:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 01:28:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 01:29:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 01:29:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 01:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:29:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 01:29:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:29:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:29:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:29:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:29:24 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 01:29:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 01:29:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 01:30:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 01:30:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:30:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:30:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:30:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:30:24 [WARNING ] (13, 1, 'bot')
2019-01-15 01:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:30:24 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-15 01:30:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 01:30:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:31:04 [DEBUG   ] Got command RPT from MCS: ref #1171615
2019-01-15 01:31:04 [DEBUG   ] summary = ERROR
2019-01-15 01:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171615  13 58498  5464865 A  ERRORERROR'
2019-01-15 01:31:04 [DEBUG   ] Got command RPT from MCS: ref #1171616
2019-01-15 01:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171616  77 58498  5464866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:31:08 [DEBUG   ] Got command RPT from MCS: ref #1171632
2019-01-15 01:31:08 [DEBUG   ] summary = ERROR
2019-01-15 01:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171632  13 58498  5468753 A  ERRORERROR'
2019-01-15 01:31:08 [DEBUG   ] Got command RPT from MCS: ref #1171633
2019-01-15 01:31:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171633  77 58498  5468945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:31:09 [DEBUG   ] Got command RPT from MCS: ref #1171634
2019-01-15 01:31:09 [DEBUG   ] summary = ERROR
2019-01-15 01:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171634  13 58498  5469149 A  ERRORERROR'
2019-01-15 01:31:09 [DEBUG   ] Got command RPT from MCS: ref #1171635
2019-01-15 01:31:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171635  77 58498  5469354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:31:09 [DEBUG   ] Got command RPT from MCS: ref #1171636
2019-01-15 01:31:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171636  12 58498  5469546 A  ERRORB˜™š'
2019-01-15 01:31:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:31:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:31:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:31:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:31:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:31:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:31:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:31:25 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-15 01:31:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 01:31:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 01:32:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:32:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 01:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:32:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:32:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:32:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:32:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:32:25 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-15 01:32:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:32:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:33:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 01:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:33:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:33:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:33:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:33:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:33:25 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-15 01:33:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 01:33:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 01:34:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 01:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:34:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:34:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:34:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:34:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:34:25 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-15 01:34:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 01:34:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 01:35:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 01:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:35:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:35:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:35:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:35:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:35:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:35:25 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-01-15 01:35:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 01:35:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:36:04 [DEBUG   ] Got command RPT from MCS: ref #1171647
2019-01-15 01:36:04 [DEBUG   ] summary = ERROR
2019-01-15 01:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171647  13 58498  5764869 A  ERRORERROR'
2019-01-15 01:36:04 [DEBUG   ] Got command RPT from MCS: ref #1171648
2019-01-15 01:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171648  77 58498  5764870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:36:08 [DEBUG   ] Got command RPT from MCS: ref #1171664
2019-01-15 01:36:08 [DEBUG   ] summary = ERROR
2019-01-15 01:36:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171664  13 58498  5768829 A  ERRORERROR'
2019-01-15 01:36:09 [DEBUG   ] Got command RPT from MCS: ref #1171665
2019-01-15 01:36:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171665  77 58498  5769033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:36:09 [DEBUG   ] Got command RPT from MCS: ref #1171666
2019-01-15 01:36:09 [DEBUG   ] summary = ERROR
2019-01-15 01:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171666  13 58498  5769225 A  ERRORERROR'
2019-01-15 01:36:09 [DEBUG   ] Got command RPT from MCS: ref #1171668
2019-01-15 01:36:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171668  77 58498  5769429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:36:09 [DEBUG   ] Got command RPT from MCS: ref #1171670
2019-01-15 01:36:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171670  12 58498  5769633 A  ERRORB—™š'
2019-01-15 01:36:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:36:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:36:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:36:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:36:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:36:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:36:25 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 01:36:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:36:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:37:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:37:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:37:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 01:37:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:37:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:37:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:37:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:37:25 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-15 01:37:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:37:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:38:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:38:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:38:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:38:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:38:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:38:25 [WARNING ] (13, 1, 'bot')
2019-01-15 01:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:38:25 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 01:38:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:38:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:39:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:39:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:39:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 01:39:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:39:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:39:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:39:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:39:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:39:26 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-15 01:39:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:39:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:40:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:40:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:40:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:40:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:40:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:40:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:40:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:40:26 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-15 01:40:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:40:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:41:04 [DEBUG   ] Got command RPT from MCS: ref #1171678
2019-01-15 01:41:04 [DEBUG   ] summary = ERROR
2019-01-15 01:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171678  13 58498  6064866 A  ERRORERROR'
2019-01-15 01:41:04 [DEBUG   ] Got command RPT from MCS: ref #1171679
2019-01-15 01:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171679  77 58498  6064866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:41:08 [DEBUG   ] Got command RPT from MCS: ref #1171695
2019-01-15 01:41:08 [DEBUG   ] summary = ERROR
2019-01-15 01:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171695  13 58498  6068909 A  ERRORERROR'
2019-01-15 01:41:09 [DEBUG   ] Got command RPT from MCS: ref #1171696
2019-01-15 01:41:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171696  77 58498  6069102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:41:09 [DEBUG   ] Got command RPT from MCS: ref #1171697
2019-01-15 01:41:09 [DEBUG   ] summary = ERROR
2019-01-15 01:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171697  13 58498  6069306 A  ERRORERROR'
2019-01-15 01:41:09 [DEBUG   ] Got command RPT from MCS: ref #1171698
2019-01-15 01:41:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171698  77 58498  6069509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:41:09 [DEBUG   ] Got command RPT from MCS: ref #1171699
2019-01-15 01:41:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171699  12 58498  6069713 A  ERRORB–™š'
2019-01-15 01:41:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:41:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:41:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:41:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:41:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:41:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:41:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:41:26 [DEBUG   ] Finished updating board flags in 2.057 seconds
2019-01-15 01:41:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:41:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:42:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:42:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:42:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:42:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:42:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:42:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:42:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:42:26 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-15 01:42:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:42:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:43:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:43:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:43:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:43:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:43:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:43:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:43:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:43:26 [DEBUG   ] Finished updating board flags in 1.878 seconds
2019-01-15 01:43:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 01:43:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 01:44:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:44:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:44:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:44:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:44:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:44:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:44:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:44:26 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-15 01:44:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 01:44:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 01:45:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 01:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:45:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:45:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:45:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:45:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:45:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:45:26 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-15 01:45:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 01:45:51 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 01:46:04 [DEBUG   ] Got command RPT from MCS: ref #1171710
2019-01-15 01:46:04 [DEBUG   ] summary = ERROR
2019-01-15 01:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171710  13 58498  6364877 A  ERRORERROR'
2019-01-15 01:46:04 [DEBUG   ] Got command RPT from MCS: ref #1171711
2019-01-15 01:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171711  77 58498  6364878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:46:08 [DEBUG   ] Got command RPT from MCS: ref #1171727
2019-01-15 01:46:08 [DEBUG   ] summary = ERROR
2019-01-15 01:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171727  13 58498  6368981 A  ERRORERROR'
2019-01-15 01:46:09 [DEBUG   ] Got command RPT from MCS: ref #1171728
2019-01-15 01:46:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171728  77 58498  6369185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:46:09 [DEBUG   ] Got command RPT from MCS: ref #1171729
2019-01-15 01:46:09 [DEBUG   ] summary = ERROR
2019-01-15 01:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171729  13 58498  6369389 A  ERRORERROR'
2019-01-15 01:46:09 [DEBUG   ] Got command RPT from MCS: ref #1171731
2019-01-15 01:46:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171731  77 58498  6369593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:46:09 [DEBUG   ] Got command RPT from MCS: ref #1171732
2019-01-15 01:46:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171732  12 58498  6369785 A  ERRORB–™š'
2019-01-15 01:46:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 01:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:46:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:46:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:46:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:46:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:46:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:46:26 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-01-15 01:46:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 01:46:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 01:47:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 01:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:47:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:47:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:47:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:47:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:47:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:47:26 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-15 01:47:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:47:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:48:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 01:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:48:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:48:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:48:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:48:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:48:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:48:26 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-15 01:48:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 01:48:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:49:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:49:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:49:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:49:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:49:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:49:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:49:26 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 01:49:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:49:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 01:50:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:50:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:50:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:50:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:50:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:50:26 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-15 01:50:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:50:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 01:51:04 [DEBUG   ] Got command RPT from MCS: ref #1171745
2019-01-15 01:51:04 [DEBUG   ] summary = ERROR
2019-01-15 01:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171745  13 58498  6664873 A  ERRORERROR'
2019-01-15 01:51:04 [DEBUG   ] Got command RPT from MCS: ref #1171746
2019-01-15 01:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171746  77 58498  6664874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:51:09 [DEBUG   ] Got command RPT from MCS: ref #1171762
2019-01-15 01:51:09 [DEBUG   ] summary = ERROR
2019-01-15 01:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171762  13 58498  6669061 A  ERRORERROR'
2019-01-15 01:51:09 [DEBUG   ] Got command RPT from MCS: ref #1171763
2019-01-15 01:51:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171763  77 58498  6669265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:51:09 [DEBUG   ] Got command RPT from MCS: ref #1171764
2019-01-15 01:51:09 [DEBUG   ] summary = ERROR
2019-01-15 01:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171764  13 58498  6669469 A  ERRORERROR'
2019-01-15 01:51:09 [DEBUG   ] Got command RPT from MCS: ref #1171765
2019-01-15 01:51:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171765  77 58498  6669673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:51:09 [DEBUG   ] Got command RPT from MCS: ref #1171766
2019-01-15 01:51:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171766  12 58498  6669865 A  ERRORB—™š'
2019-01-15 01:51:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 01:51:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:51:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:51:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:51:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:51:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:51:26 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-15 01:51:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 01:51:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 01:52:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 01:52:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:52:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:52:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:52:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:52:26 [WARNING ] (13, 1, 'bot')
2019-01-15 01:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:52:26 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-15 01:52:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 01:52:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 01:53:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 01:53:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:53:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:53:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:53:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:53:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:53:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:53:27 [DEBUG   ] Finished updating board flags in 2.234 seconds
2019-01-15 01:53:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 01:53:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 01:54:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 01:54:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:54:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:54:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:54:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:54:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:54:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:54:27 [DEBUG   ] Finished updating board flags in 2.155 seconds
2019-01-15 01:54:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 01:54:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 01:55:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 01:55:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:55:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:55:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:55:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:55:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:55:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:55:27 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-15 01:55:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:55:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 01:56:04 [DEBUG   ] Got command RPT from MCS: ref #1171773
2019-01-15 01:56:04 [DEBUG   ] summary = ERROR
2019-01-15 01:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171773  13 58498  6964877 A  ERRORERROR'
2019-01-15 01:56:04 [DEBUG   ] Got command RPT from MCS: ref #1171774
2019-01-15 01:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171774  77 58498  6964878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:56:09 [DEBUG   ] Got command RPT from MCS: ref #1171790
2019-01-15 01:56:09 [DEBUG   ] summary = ERROR
2019-01-15 01:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171790  13 58498  6969149 A  ERRORERROR'
2019-01-15 01:56:09 [DEBUG   ] Got command RPT from MCS: ref #1171791
2019-01-15 01:56:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171791  77 58498  6969353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:56:09 [DEBUG   ] Got command RPT from MCS: ref #1171792
2019-01-15 01:56:09 [DEBUG   ] summary = ERROR
2019-01-15 01:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171792  13 58498  6969545 A  ERRORERROR'
2019-01-15 01:56:09 [DEBUG   ] Got command RPT from MCS: ref #1171794
2019-01-15 01:56:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 01:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171794  77 58498  6969749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 01:56:09 [DEBUG   ] Got command RPT from MCS: ref #1171796
2019-01-15 01:56:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 01:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171796  12 58498  6969953 A  ERRORB–™š'
2019-01-15 01:56:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 01:56:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:56:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:56:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:56:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:56:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:56:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:56:27 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-15 01:56:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 01:56:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 01:57:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 01:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:57:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:57:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:57:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:57:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:57:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:57:27 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-15 01:57:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 01:57:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 01:58:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 01:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:58:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:58:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:58:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:58:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:58:27 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 01:58:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 01:58:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 01:59:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 01:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 01:59:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:59:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:59:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:59:27 [WARNING ] (13, 1, 'bot')
2019-01-15 01:59:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 01:59:27 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-15 01:59:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 01:59:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:00:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:00:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:00:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:00:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:00:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:00:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:00:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:00:27 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-15 02:00:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 02:00:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:01:04 [DEBUG   ] Got command RPT from MCS: ref #1171808
2019-01-15 02:01:04 [DEBUG   ] summary = ERROR
2019-01-15 02:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171808  13 58498  7264874 A  ERRORERROR'
2019-01-15 02:01:04 [DEBUG   ] Got command RPT from MCS: ref #1171809
2019-01-15 02:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171809  77 58498  7264874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:01:09 [DEBUG   ] Got command RPT from MCS: ref #1171825
2019-01-15 02:01:09 [DEBUG   ] summary = ERROR
2019-01-15 02:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171825  13 58498  7269229 A  ERRORERROR'
2019-01-15 02:01:09 [DEBUG   ] Got command RPT from MCS: ref #1171826
2019-01-15 02:01:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171826  77 58498  7269433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:01:09 [DEBUG   ] Got command RPT from MCS: ref #1171827
2019-01-15 02:01:09 [DEBUG   ] summary = ERROR
2019-01-15 02:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171827  13 58498  7269626 A  ERRORERROR'
2019-01-15 02:01:09 [DEBUG   ] Got command RPT from MCS: ref #1171828
2019-01-15 02:01:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171828  77 58498  7269829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:01:10 [DEBUG   ] Got command RPT from MCS: ref #1171829
2019-01-15 02:01:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171829  12 58498  7270033 A  ERRORB–™š'
2019-01-15 02:01:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:01:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:01:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:01:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:01:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:01:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:01:27 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-15 02:01:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:01:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 02:02:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 02:02:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:02:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:02:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:02:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:02:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:02:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:02:27 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-15 02:02:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:02:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 02:03:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 02:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:03:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:03:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:03:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:03:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:03:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:03:27 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-15 02:03:35 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2019-01-15 02:03:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 02:04:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 02:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:04:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:04:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:04:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:04:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:04:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:04:27 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-15 02:04:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 02:04:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:05:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:05:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:05:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:05:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:05:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:05:27 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-15 02:05:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:05:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:06:04 [DEBUG   ] Got command RPT from MCS: ref #1171840
2019-01-15 02:06:04 [DEBUG   ] summary = ERROR
2019-01-15 02:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171840  13 58498  7564877 A  ERRORERROR'
2019-01-15 02:06:04 [DEBUG   ] Got command RPT from MCS: ref #1171841
2019-01-15 02:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171841  77 58498  7564878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:06:09 [DEBUG   ] Got command RPT from MCS: ref #1171857
2019-01-15 02:06:09 [DEBUG   ] summary = ERROR
2019-01-15 02:06:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171857  13 58498  7569305 A  ERRORERROR'
2019-01-15 02:06:09 [DEBUG   ] Got command RPT from MCS: ref #1171858
2019-01-15 02:06:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:06:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171858  77 58498  7569509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:06:09 [DEBUG   ] Got command RPT from MCS: ref #1171859
2019-01-15 02:06:09 [DEBUG   ] summary = ERROR
2019-01-15 02:06:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171859  13 58498  7569713 A  ERRORERROR'
2019-01-15 02:06:09 [DEBUG   ] Got command RPT from MCS: ref #1171860
2019-01-15 02:06:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:06:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171860  77 58498  7569905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:06:10 [DEBUG   ] Got command RPT from MCS: ref #1171862
2019-01-15 02:06:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171862  12 58498  7570109 A  ERRORB—™š'
2019-01-15 02:06:15 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2019-01-15 02:06:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:06:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:06:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:06:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:06:27 [WARNING ] (13, 1, 'bot')
2019-01-15 02:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:06:27 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-15 02:06:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:06:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:07:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 02:07:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:07:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 02:07:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:07:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:07:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:07:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:07:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:07:28 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-01-15 02:07:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:07:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:08:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 02:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:08:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:08:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:08:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:08:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:08:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:08:28 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-15 02:08:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 02:08:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 02:09:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 02:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:09:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:09:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:09:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:09:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:09:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:09:28 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-15 02:09:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 02:09:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:10:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:10:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:10:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:10:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:10:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:10:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:10:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:10:28 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-15 02:10:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:10:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:11:04 [DEBUG   ] Got command RPT from MCS: ref #1171871
2019-01-15 02:11:04 [DEBUG   ] summary = ERROR
2019-01-15 02:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171871  13 58498  7864873 A  ERRORERROR'
2019-01-15 02:11:04 [DEBUG   ] Got command RPT from MCS: ref #1171872
2019-01-15 02:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171872  77 58498  7864874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:11:09 [DEBUG   ] Got command RPT from MCS: ref #1171888
2019-01-15 02:11:09 [DEBUG   ] summary = ERROR
2019-01-15 02:11:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171888  13 58498  7869385 A  ERRORERROR'
2019-01-15 02:11:09 [DEBUG   ] Got command RPT from MCS: ref #1171889
2019-01-15 02:11:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:11:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171889  77 58498  7869589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:11:09 [DEBUG   ] Got command RPT from MCS: ref #1171890
2019-01-15 02:11:09 [DEBUG   ] summary = ERROR
2019-01-15 02:11:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171890  13 58498  7869793 A  ERRORERROR'
2019-01-15 02:11:09 [DEBUG   ] Got command RPT from MCS: ref #1171891
2019-01-15 02:11:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:11:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171891  77 58498  7869997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:11:10 [DEBUG   ] Got command RPT from MCS: ref #1171892
2019-01-15 02:11:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:11:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171892  12 58498  7870189 A  ERRORB–™š'
2019-01-15 02:11:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:11:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:11:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 02:11:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:11:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:11:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:11:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:11:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:11:28 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-15 02:11:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:11:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 02:12:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 02:12:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:12:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 02:12:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:12:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:12:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:12:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:12:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:12:28 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 02:12:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 02:12:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:13:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 02:13:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:13:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:13:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:13:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:13:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:13:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:13:28 [DEBUG   ] Finished updating board flags in 1.675 seconds
2019-01-15 02:13:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 02:13:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 02:14:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 02:14:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 02:14:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:14:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:14:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:14:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:14:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:14:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:14:28 [DEBUG   ] Finished updating board flags in 1.526 seconds
2019-01-15 02:14:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 02:14:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:15:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:15:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:15:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:15:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:15:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:15:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:15:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:15:28 [DEBUG   ] Finished updating board flags in 1.469 seconds
2019-01-15 02:15:37 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 02:15:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:16:04 [DEBUG   ] Got command RPT from MCS: ref #1171903
2019-01-15 02:16:04 [DEBUG   ] summary = ERROR
2019-01-15 02:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171903  13 58498  8164881 A  ERRORERROR'
2019-01-15 02:16:04 [DEBUG   ] Got command RPT from MCS: ref #1171904
2019-01-15 02:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171904  77 58498  8164882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:16:09 [DEBUG   ] Got command RPT from MCS: ref #1171920
2019-01-15 02:16:09 [DEBUG   ] summary = ERROR
2019-01-15 02:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171920  13 58498  8169465 A  ERRORERROR'
2019-01-15 02:16:09 [DEBUG   ] Got command RPT from MCS: ref #1171921
2019-01-15 02:16:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171921  77 58498  8169669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:16:09 [DEBUG   ] Got command RPT from MCS: ref #1171922
2019-01-15 02:16:09 [DEBUG   ] summary = ERROR
2019-01-15 02:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171922  13 58498  8169873 A  ERRORERROR'
2019-01-15 02:16:10 [DEBUG   ] Got command RPT from MCS: ref #1171924
2019-01-15 02:16:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171924  77 58498  8170077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:16:10 [DEBUG   ] Got command RPT from MCS: ref #1171926
2019-01-15 02:16:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171926  12 58498  8170269 A  ERRORB—™š'
2019-01-15 02:16:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:16:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 02:16:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:16:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:16:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:16:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:16:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:16:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:16:28 [DEBUG   ] Finished updating board flags in 1.470 seconds
2019-01-15 02:16:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:16:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 02:17:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 02:17:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:17:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:17:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:17:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:17:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:17:28 [DEBUG   ] Finished updating board flags in 1.470 seconds
2019-01-15 02:17:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:17:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 02:18:17 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 02:18:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:18:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 02:18:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:18:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:18:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:18:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:18:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:18:29 [DEBUG   ] Finished updating board flags in 2.203 seconds
2019-01-15 02:18:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 02:18:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 02:19:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 02:19:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:19:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:19:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:19:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:19:28 [WARNING ] (13, 1, 'bot')
2019-01-15 02:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:19:28 [DEBUG   ] Finished updating board flags in 1.318 seconds
2019-01-15 02:19:38 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 02:19:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 02:20:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 02:20:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:20:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:20:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:20:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:20:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:20:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:20:29 [DEBUG   ] Finished updating board flags in 2.091 seconds
2019-01-15 02:20:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 02:20:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:21:04 [DEBUG   ] Got command RPT from MCS: ref #1171938
2019-01-15 02:21:04 [DEBUG   ] summary = ERROR
2019-01-15 02:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171938  13 58498  8464885 A  ERRORERROR'
2019-01-15 02:21:04 [DEBUG   ] Got command RPT from MCS: ref #1171939
2019-01-15 02:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171939  77 58498  8464886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:21:09 [DEBUG   ] Got command RPT from MCS: ref #1171955
2019-01-15 02:21:09 [DEBUG   ] summary = ERROR
2019-01-15 02:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171955  13 58498  8469553 A  ERRORERROR'
2019-01-15 02:21:09 [DEBUG   ] Got command RPT from MCS: ref #1171956
2019-01-15 02:21:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171956  77 58498  8469745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:21:09 [DEBUG   ] Got command RPT from MCS: ref #1171957
2019-01-15 02:21:09 [DEBUG   ] summary = ERROR
2019-01-15 02:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171957  13 58498  8469949 A  ERRORERROR'
2019-01-15 02:21:10 [DEBUG   ] Got command RPT from MCS: ref #1171958
2019-01-15 02:21:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:21:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171958  77 58498  8470153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:21:10 [DEBUG   ] Got command RPT from MCS: ref #1171959
2019-01-15 02:21:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:21:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171959  12 58498  8470357 A  ERRORB—™š'
2019-01-15 02:21:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:21:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:21:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:21:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:21:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:21:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:21:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:21:29 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-15 02:21:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:21:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:22:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:22:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:22:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:22:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:22:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:22:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:22:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:22:29 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-15 02:22:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:22:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:23:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 02:23:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:23:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 02:23:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:23:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:23:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:23:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:23:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:23:29 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-15 02:23:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 02:23:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 02:24:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 02:24:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:24:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:24:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:24:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:24:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:24:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:24:29 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-01-15 02:24:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 02:24:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 02:25:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 02:25:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:25:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:25:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:25:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:25:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:25:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:25:29 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-15 02:25:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 02:25:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:26:04 [DEBUG   ] Got command RPT from MCS: ref #1171966
2019-01-15 02:26:04 [DEBUG   ] summary = ERROR
2019-01-15 02:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171966  13 58498  8764885 A  ERRORERROR'
2019-01-15 02:26:04 [DEBUG   ] Got command RPT from MCS: ref #1171967
2019-01-15 02:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171967  77 58498  8764886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:26:09 [DEBUG   ] Got command RPT from MCS: ref #1171983
2019-01-15 02:26:09 [DEBUG   ] summary = ERROR
2019-01-15 02:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171983  13 58498  8769625 A  ERRORERROR'
2019-01-15 02:26:09 [DEBUG   ] Got command RPT from MCS: ref #1171984
2019-01-15 02:26:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171984  77 58498  8769829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:26:10 [DEBUG   ] Got command RPT from MCS: ref #1171985
2019-01-15 02:26:10 [DEBUG   ] summary = ERROR
2019-01-15 02:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171985  13 58498  8770033 A  ERRORERROR'
2019-01-15 02:26:10 [DEBUG   ] Got command RPT from MCS: ref #1171987
2019-01-15 02:26:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171987  77 58498  8770237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:26:10 [DEBUG   ] Got command RPT from MCS: ref #1171988
2019-01-15 02:26:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1171988  12 58498  8770429 A  ERRORB–™š'
2019-01-15 02:26:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:26:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:26:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:26:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:26:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:26:29 [WARNING ] (13, 1, 'bot')
2019-01-15 02:26:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:26:29 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-01-15 02:26:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:26:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:27:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:27:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:27:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:27:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:27:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:27:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:27:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:27:30 [DEBUG   ] Finished updating board flags in 2.072 seconds
2019-01-15 02:27:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:27:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:28:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 02:28:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:28:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:28:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:28:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:28:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:28:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:28:30 [DEBUG   ] Finished updating board flags in 2.032 seconds
2019-01-15 02:28:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:28:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:29:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 02:29:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:29:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:29:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:29:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:29:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:29:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:29:30 [DEBUG   ] Finished updating board flags in 1.966 seconds
2019-01-15 02:29:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 02:30:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 02:30:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 02:30:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:30:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:30:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:30:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:30:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:30:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:30:30 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-15 02:30:40 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-15 02:31:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:31:04 [DEBUG   ] Got command RPT from MCS: ref #1172001
2019-01-15 02:31:04 [DEBUG   ] summary = ERROR
2019-01-15 02:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172001  13 58498  9064885 A  ERRORERROR'
2019-01-15 02:31:04 [DEBUG   ] Got command RPT from MCS: ref #1172002
2019-01-15 02:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172002  77 58498  9064886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:31:09 [DEBUG   ] Got command RPT from MCS: ref #1172018
2019-01-15 02:31:09 [DEBUG   ] summary = ERROR
2019-01-15 02:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172018  13 58498  9069709 A  ERRORERROR'
2019-01-15 02:31:09 [DEBUG   ] Got command RPT from MCS: ref #1172019
2019-01-15 02:31:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172019  77 58498  9069913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:31:10 [DEBUG   ] Got command RPT from MCS: ref #1172020
2019-01-15 02:31:10 [DEBUG   ] summary = ERROR
2019-01-15 02:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172020  13 58498  9070117 A  ERRORERROR'
2019-01-15 02:31:10 [DEBUG   ] Got command RPT from MCS: ref #1172021
2019-01-15 02:31:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172021  77 58498  9070309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:31:10 [DEBUG   ] Got command RPT from MCS: ref #1172022
2019-01-15 02:31:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172022  12 58498  9070513 A  ERRORB–™š'
2019-01-15 02:31:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:31:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:31:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:31:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:31:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:31:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:31:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:31:30 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-15 02:31:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:32:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:32:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:32:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 02:32:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:32:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:32:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:32:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:32:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:32:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:32:30 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 02:32:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:33:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:33:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 02:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:33:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:33:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:33:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:33:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:33:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:33:30 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-15 02:33:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 02:34:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:34:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 02:34:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:34:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:34:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:34:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:34:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:34:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:34:30 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-15 02:34:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 02:35:00 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 02:35:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 02:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:35:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:35:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:35:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:35:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:35:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:35:30 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-15 02:35:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 02:36:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 02:36:04 [DEBUG   ] Got command RPT from MCS: ref #1172033
2019-01-15 02:36:04 [DEBUG   ] summary = ERROR
2019-01-15 02:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172033  13 58498  9364889 A  ERRORERROR'
2019-01-15 02:36:04 [DEBUG   ] Got command RPT from MCS: ref #1172034
2019-01-15 02:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172034  77 58498  9364890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:36:09 [DEBUG   ] Got command RPT from MCS: ref #1172050
2019-01-15 02:36:09 [DEBUG   ] summary = ERROR
2019-01-15 02:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172050  13 58498  9369797 A  ERRORERROR'
2019-01-15 02:36:09 [DEBUG   ] Got command RPT from MCS: ref #1172051
2019-01-15 02:36:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172051  77 58498  9369989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:36:10 [DEBUG   ] Got command RPT from MCS: ref #1172052
2019-01-15 02:36:10 [DEBUG   ] summary = ERROR
2019-01-15 02:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172052  13 58498  9370193 A  ERRORERROR'
2019-01-15 02:36:10 [DEBUG   ] Got command RPT from MCS: ref #1172054
2019-01-15 02:36:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172054  77 58498  9370397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:36:10 [DEBUG   ] Got command RPT from MCS: ref #1172055
2019-01-15 02:36:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172055  12 58498  9370601 A  ERRORB—™š'
2019-01-15 02:36:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 02:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:36:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:36:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:36:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:36:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:36:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:36:30 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-01-15 02:36:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 02:37:01 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 02:37:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:37:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:37:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:37:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:37:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:37:30 [WARNING ] (13, 1, 'bot')
2019-01-15 02:37:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:37:30 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-01-15 02:37:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:38:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:38:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 02:38:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:38:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 02:38:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:38:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:38:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:38:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:38:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:38:31 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-15 02:38:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:39:01 [DEBUG   ] Finished updating ant stats in 0.817 seconds
2019-01-15 02:39:21 [DEBUG   ] Finished updating ant stats in 0.788 seconds
2019-01-15 02:39:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:39:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:39:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:39:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:39:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:39:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:39:31 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-15 02:39:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 02:40:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 02:40:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 02:40:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:40:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:40:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:40:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:40:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:40:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:40:31 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-15 02:40:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 02:41:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 02:41:04 [DEBUG   ] Got command RPT from MCS: ref #1172064
2019-01-15 02:41:04 [DEBUG   ] summary = ERROR
2019-01-15 02:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172064  13 58498  9664889 A  ERRORERROR'
2019-01-15 02:41:04 [DEBUG   ] Got command RPT from MCS: ref #1172065
2019-01-15 02:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172065  77 58498  9664890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:41:09 [DEBUG   ] Got command RPT from MCS: ref #1172081
2019-01-15 02:41:09 [DEBUG   ] summary = ERROR
2019-01-15 02:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172081  13 58498  9669869 A  ERRORERROR'
2019-01-15 02:41:10 [DEBUG   ] Got command RPT from MCS: ref #1172082
2019-01-15 02:41:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172082  77 58498  9670073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:41:10 [DEBUG   ] Got command RPT from MCS: ref #1172083
2019-01-15 02:41:10 [DEBUG   ] summary = ERROR
2019-01-15 02:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172083  13 58498  9670277 A  ERRORERROR'
2019-01-15 02:41:10 [DEBUG   ] Got command RPT from MCS: ref #1172084
2019-01-15 02:41:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172084  77 58498  9670469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:41:10 [DEBUG   ] Got command RPT from MCS: ref #1172085
2019-01-15 02:41:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172085  12 58498  9670673 A  ERRORB–™š'
2019-01-15 02:41:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 02:41:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:41:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 02:41:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:41:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:41:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:41:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:41:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:41:31 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-15 02:41:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 02:42:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:42:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:42:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:42:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:42:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:42:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:42:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:42:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:42:31 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-15 02:42:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 02:43:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:43:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:43:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:43:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:43:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:43:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:43:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:43:31 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 02:43:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:44:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 02:44:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 02:44:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:44:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:44:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:44:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:44:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:44:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:44:31 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-01-15 02:44:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:45:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 02:45:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 02:45:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:45:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:45:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:45:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:45:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:45:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:45:31 [DEBUG   ] Finished updating board flags in 1.446 seconds
2019-01-15 02:45:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 02:46:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 02:46:04 [DEBUG   ] Got command RPT from MCS: ref #1172096
2019-01-15 02:46:04 [DEBUG   ] summary = ERROR
2019-01-15 02:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172096  13 58498  9964889 A  ERRORERROR'
2019-01-15 02:46:04 [DEBUG   ] Got command RPT from MCS: ref #1172097
2019-01-15 02:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172097  77 58498  9964890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:46:09 [DEBUG   ] Got command RPT from MCS: ref #1172113
2019-01-15 02:46:09 [DEBUG   ] summary = ERROR
2019-01-15 02:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172113  13 58498  9969953 A  ERRORERROR'
2019-01-15 02:46:10 [DEBUG   ] Got command RPT from MCS: ref #1172114
2019-01-15 02:46:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172114  77 58498  9970157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:46:10 [DEBUG   ] Got command RPT from MCS: ref #1172115
2019-01-15 02:46:10 [DEBUG   ] summary = ERROR
2019-01-15 02:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172115  13 58498  9970349 A  ERRORERROR'
2019-01-15 02:46:10 [DEBUG   ] Got command RPT from MCS: ref #1172117
2019-01-15 02:46:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172117  77 58498  9970553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:46:10 [DEBUG   ] Got command RPT from MCS: ref #1172118
2019-01-15 02:46:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172118  12 58498  9970757 A  ERRORB•™š'
2019-01-15 02:46:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 02:46:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:46:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 02:46:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:46:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:46:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:46:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:46:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:46:31 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-01-15 02:46:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 02:47:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:47:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:47:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:47:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 02:47:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:47:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:47:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:47:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:47:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:47:31 [DEBUG   ] Finished updating board flags in 1.448 seconds
2019-01-15 02:47:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:48:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 02:48:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:48:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-15 02:48:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:48:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 02:48:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:48:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:48:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:48:31 [WARNING ] (13, 1, 'bot')
2019-01-15 02:48:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:48:31 [DEBUG   ] Finished updating board flags in 1.452 seconds
2019-01-15 02:48:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 02:49:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:49:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 02:49:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 02:49:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:49:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 02:49:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:49:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:49:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:49:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:49:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:49:32 [DEBUG   ] Finished updating board flags in 2.228 seconds
2019-01-15 02:49:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:50:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:50:23 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 02:50:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:50:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:50:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:50:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:50:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:50:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:50:32 [DEBUG   ] Finished updating board flags in 2.140 seconds
2019-01-15 02:50:43 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-15 02:51:04 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2019-01-15 02:51:04 [DEBUG   ] Got command RPT from MCS: ref #1172131
2019-01-15 02:51:04 [DEBUG   ] summary = ERROR
2019-01-15 02:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172131  13 58498 10264881 A  ERRORERROR'
2019-01-15 02:51:04 [DEBUG   ] Got command RPT from MCS: ref #1172132
2019-01-15 02:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172132  77 58498 10264882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:51:10 [DEBUG   ] Got command RPT from MCS: ref #1172148
2019-01-15 02:51:10 [DEBUG   ] summary = ERROR
2019-01-15 02:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172148  13 58498 10270029 A  ERRORERROR'
2019-01-15 02:51:10 [DEBUG   ] Got command RPT from MCS: ref #1172149
2019-01-15 02:51:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172149  77 58498 10270233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:51:10 [DEBUG   ] Got command RPT from MCS: ref #1172150
2019-01-15 02:51:10 [DEBUG   ] summary = ERROR
2019-01-15 02:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172150  13 58498 10270437 A  ERRORERROR'
2019-01-15 02:51:10 [DEBUG   ] Got command RPT from MCS: ref #1172151
2019-01-15 02:51:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172151  77 58498 10270641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:51:10 [DEBUG   ] Got command RPT from MCS: ref #1172152
2019-01-15 02:51:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172152  12 58498 10270833 A  ERRORB—™š'
2019-01-15 02:51:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 02:51:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:51:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:51:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:51:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:51:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:51:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:51:32 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-15 02:51:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 02:52:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 02:52:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:52:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:52:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 02:52:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:52:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:52:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:52:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:52:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:52:32 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 02:52:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 02:53:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 02:53:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 02:53:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:53:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:53:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:53:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:53:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:53:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:53:32 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-15 02:53:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:54:04 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2019-01-15 02:54:25 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 02:54:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:54:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:54:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:54:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:54:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:54:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:54:32 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-15 02:54:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 02:55:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 02:55:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 02:55:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:55:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:55:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:55:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:55:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:55:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:55:32 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 02:55:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 02:56:04 [DEBUG   ] Got command RPT from MCS: ref #1172159
2019-01-15 02:56:04 [DEBUG   ] summary = ERROR
2019-01-15 02:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172159  13 58498 10564885 A  ERRORERROR'
2019-01-15 02:56:04 [DEBUG   ] Got command RPT from MCS: ref #1172160
2019-01-15 02:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172160  77 58498 10564886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:56:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 02:56:10 [DEBUG   ] Got command RPT from MCS: ref #1172176
2019-01-15 02:56:10 [DEBUG   ] summary = ERROR
2019-01-15 02:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172176  13 58498 10570117 A  ERRORERROR'
2019-01-15 02:56:10 [DEBUG   ] Got command RPT from MCS: ref #1172177
2019-01-15 02:56:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172177  77 58498 10570321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:56:10 [DEBUG   ] Got command RPT from MCS: ref #1172178
2019-01-15 02:56:10 [DEBUG   ] summary = ERROR
2019-01-15 02:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172178  13 58498 10570513 A  ERRORERROR'
2019-01-15 02:56:10 [DEBUG   ] Got command RPT from MCS: ref #1172180
2019-01-15 02:56:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 02:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172180  77 58498 10570717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 02:56:10 [DEBUG   ] Got command RPT from MCS: ref #1172181
2019-01-15 02:56:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 02:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172181  12 58498 10570921 A  ERRORB–™š'
2019-01-15 02:56:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 02:56:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:56:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 02:56:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:56:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:56:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:56:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:56:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:56:32 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-15 02:56:45 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-15 02:57:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 02:57:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:57:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:57:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:57:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:57:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:57:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:57:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:57:32 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 02:57:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 02:58:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 02:58:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 02:58:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:58:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:58:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:58:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:58:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:58:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:58:32 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 02:58:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 02:59:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 02:59:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 02:59:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 02:59:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:59:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:59:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:59:32 [WARNING ] (13, 1, 'bot')
2019-01-15 02:59:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 02:59:32 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-15 02:59:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 03:00:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 03:00:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 03:00:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:00:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:00:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:00:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:00:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:00:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:00:33 [DEBUG   ] Finished updating board flags in 2.056 seconds
2019-01-15 03:00:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:01:04 [DEBUG   ] Got command RPT from MCS: ref #1172194
2019-01-15 03:01:04 [DEBUG   ] summary = ERROR
2019-01-15 03:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172194  13 58498 10864893 A  ERRORERROR'
2019-01-15 03:01:04 [DEBUG   ] Got command RPT from MCS: ref #1172195
2019-01-15 03:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172195  77 58498 10864894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:01:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 03:01:10 [DEBUG   ] Got command RPT from MCS: ref #1172211
2019-01-15 03:01:10 [DEBUG   ] summary = ERROR
2019-01-15 03:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172211  13 58498 10870197 A  ERRORERROR'
2019-01-15 03:01:10 [DEBUG   ] Got command RPT from MCS: ref #1172212
2019-01-15 03:01:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172212  77 58498 10870389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:01:10 [DEBUG   ] Got command RPT from MCS: ref #1172213
2019-01-15 03:01:10 [DEBUG   ] summary = ERROR
2019-01-15 03:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172213  13 58498 10870593 A  ERRORERROR'
2019-01-15 03:01:10 [DEBUG   ] Got command RPT from MCS: ref #1172214
2019-01-15 03:01:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172214  77 58498 10870797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:01:11 [DEBUG   ] Got command RPT from MCS: ref #1172215
2019-01-15 03:01:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172215  12 58498 10871001 A  ERRORB•™š'
2019-01-15 03:01:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 03:01:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:01:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:01:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:01:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:01:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:01:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:01:33 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-15 03:01:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:02:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:02:26 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 03:02:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:02:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:02:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:02:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:02:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:02:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:02:33 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 03:02:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 03:03:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:03:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 03:03:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:03:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:03:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:03:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:03:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:03:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:03:33 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 03:03:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:04:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:04:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:04:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:04:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 03:04:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:04:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:04:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:04:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:04:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:04:33 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-15 03:04:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:05:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:05:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:05:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 03:05:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:05:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:05:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:05:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:05:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:05:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:05:33 [DEBUG   ] Finished updating board flags in 1.653 seconds
2019-01-15 03:05:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:06:04 [DEBUG   ] Got command RPT from MCS: ref #1172226
2019-01-15 03:06:04 [DEBUG   ] summary = ERROR
2019-01-15 03:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172226  13 58498 11164885 A  ERRORERROR'
2019-01-15 03:06:04 [DEBUG   ] Got command RPT from MCS: ref #1172227
2019-01-15 03:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172227  77 58498 11164886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:06:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 03:06:10 [DEBUG   ] Got command RPT from MCS: ref #1172243
2019-01-15 03:06:10 [DEBUG   ] summary = ERROR
2019-01-15 03:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172243  13 58498 11170273 A  ERRORERROR'
2019-01-15 03:06:10 [DEBUG   ] Got command RPT from MCS: ref #1172244
2019-01-15 03:06:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172244  77 58498 11170477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:06:10 [DEBUG   ] Got command RPT from MCS: ref #1172245
2019-01-15 03:06:10 [DEBUG   ] summary = ERROR
2019-01-15 03:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172245  13 58498 11170681 A  ERRORERROR'
2019-01-15 03:06:10 [DEBUG   ] Got command RPT from MCS: ref #1172247
2019-01-15 03:06:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172247  77 58498 11170873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:06:11 [DEBUG   ] Got command RPT from MCS: ref #1172248
2019-01-15 03:06:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172248  12 58498 11171077 A  ERRORB—™š'
2019-01-15 03:06:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 03:06:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:06:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 03:06:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:06:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:06:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:06:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:06:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:06:33 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 03:06:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 03:07:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:07:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 03:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:07:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:07:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:07:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:07:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:07:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:07:33 [DEBUG   ] Finished updating board flags in 1.533 seconds
2019-01-15 03:07:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 03:08:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 03:08:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 03:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:08:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:08:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:08:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:08:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:08:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:08:33 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-15 03:08:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 03:09:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:09:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 03:09:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:09:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:09:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:09:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:09:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:09:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:09:33 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 03:09:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:10:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:10:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 03:10:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:10:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:10:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:10:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:10:33 [WARNING ] (13, 1, 'bot')
2019-01-15 03:10:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:10:33 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-15 03:10:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 03:11:04 [DEBUG   ] Got command RPT from MCS: ref #1172257
2019-01-15 03:11:04 [DEBUG   ] summary = ERROR
2019-01-15 03:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172257  13 58498 11464893 A  ERRORERROR'
2019-01-15 03:11:04 [DEBUG   ] Got command RPT from MCS: ref #1172258
2019-01-15 03:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172258  77 58498 11464894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:11:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 03:11:10 [DEBUG   ] Got command RPT from MCS: ref #1172274
2019-01-15 03:11:10 [DEBUG   ] summary = ERROR
2019-01-15 03:11:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172274  13 58498 11470353 A  ERRORERROR'
2019-01-15 03:11:10 [DEBUG   ] Got command RPT from MCS: ref #1172275
2019-01-15 03:11:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:11:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172275  77 58498 11470557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:11:10 [DEBUG   ] Got command RPT from MCS: ref #1172276
2019-01-15 03:11:10 [DEBUG   ] summary = ERROR
2019-01-15 03:11:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172276  13 58498 11470761 A  ERRORERROR'
2019-01-15 03:11:10 [DEBUG   ] Got command RPT from MCS: ref #1172277
2019-01-15 03:11:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:11:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172277  77 58498 11470953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:11:11 [DEBUG   ] Got command RPT from MCS: ref #1172278
2019-01-15 03:11:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172278  12 58498 11471157 A  ERRORB—™š'
2019-01-15 03:11:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 03:11:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:11:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 03:11:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:11:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:11:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:11:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:11:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:11:34 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-01-15 03:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:12:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 03:12:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:12:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:12:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:12:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:12:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:12:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:12:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:12:34 [DEBUG   ] Finished updating board flags in 2.214 seconds
2019-01-15 03:12:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 03:13:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:13:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 03:13:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:13:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:13:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:13:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:13:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:13:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:13:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:13:34 [DEBUG   ] Finished updating board flags in 2.161 seconds
2019-01-15 03:13:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 03:14:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:14:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:14:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:14:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:14:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:14:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:14:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:14:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:14:34 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-15 03:14:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:15:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 03:15:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:15:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:15:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:15:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:15:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:15:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:15:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:15:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:15:34 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-15 03:15:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:16:04 [DEBUG   ] Got command RPT from MCS: ref #1172289
2019-01-15 03:16:04 [DEBUG   ] summary = ERROR
2019-01-15 03:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172289  13 58498 11764889 A  ERRORERROR'
2019-01-15 03:16:04 [DEBUG   ] Got command RPT from MCS: ref #1172290
2019-01-15 03:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172290  77 58498 11764890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:16:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:16:10 [DEBUG   ] Got command RPT from MCS: ref #1172306
2019-01-15 03:16:10 [DEBUG   ] summary = ERROR
2019-01-15 03:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172306  13 58498 11770433 A  ERRORERROR'
2019-01-15 03:16:10 [DEBUG   ] Got command RPT from MCS: ref #1172307
2019-01-15 03:16:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172307  77 58498 11770637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:16:10 [DEBUG   ] Got command RPT from MCS: ref #1172308
2019-01-15 03:16:10 [DEBUG   ] summary = ERROR
2019-01-15 03:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172308  13 58498 11770841 A  ERRORERROR'
2019-01-15 03:16:11 [DEBUG   ] Got command RPT from MCS: ref #1172310
2019-01-15 03:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172310  77 58498 11771033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:16:11 [DEBUG   ] Got command RPT from MCS: ref #1172311
2019-01-15 03:16:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172311  12 58498 11771237 A  ERRORB•™š'
2019-01-15 03:16:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 03:16:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:16:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:16:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:16:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:16:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:16:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:16:34 [DEBUG   ] Finished updating board flags in 2.067 seconds
2019-01-15 03:16:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:17:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:17:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:17:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:17:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:17:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:17:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:17:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:17:34 [DEBUG   ] Finished updating board flags in 1.931 seconds
2019-01-15 03:17:49 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-15 03:18:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 03:18:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 03:18:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:18:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:18:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:18:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:18:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:18:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:18:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:18:34 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-15 03:18:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:19:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 03:19:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:19:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 03:19:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:19:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:19:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:19:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:19:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:19:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:19:34 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-15 03:19:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 03:20:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 03:20:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:20:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:20:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:20:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:20:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:20:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:20:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:20:34 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-15 03:20:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:21:04 [DEBUG   ] Got command RPT from MCS: ref #1172324
2019-01-15 03:21:04 [DEBUG   ] summary = ERROR
2019-01-15 03:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172324  13 58498 12064893 A  ERRORERROR'
2019-01-15 03:21:04 [DEBUG   ] Got command RPT from MCS: ref #1172325
2019-01-15 03:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172325  77 58498 12064894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:21:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 03:21:10 [DEBUG   ] Got command RPT from MCS: ref #1172341
2019-01-15 03:21:10 [DEBUG   ] summary = ERROR
2019-01-15 03:21:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172341  13 58498 12070513 A  ERRORERROR'
2019-01-15 03:21:10 [DEBUG   ] Got command RPT from MCS: ref #1172342
2019-01-15 03:21:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:21:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172342  77 58498 12070717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:21:10 [DEBUG   ] Got command RPT from MCS: ref #1172343
2019-01-15 03:21:10 [DEBUG   ] summary = ERROR
2019-01-15 03:21:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172343  13 58498 12070921 A  ERRORERROR'
2019-01-15 03:21:11 [DEBUG   ] Got command RPT from MCS: ref #1172344
2019-01-15 03:21:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172344  77 58498 12071113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:21:11 [DEBUG   ] Got command RPT from MCS: ref #1172345
2019-01-15 03:21:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172345  12 58498 12071317 A  ERRORB—™š'
2019-01-15 03:21:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:21:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:21:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:21:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:21:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:21:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:21:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:21:34 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-15 03:21:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:22:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 03:22:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 03:22:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:22:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:22:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:22:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:22:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:22:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:22:34 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 03:22:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:23:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:23:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:23:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:23:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:23:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:23:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:23:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:23:34 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 03:23:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:24:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:24:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:24:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:24:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:24:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:24:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:24:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:24:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:24:34 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-15 03:24:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:25:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 03:25:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:25:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:25:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:25:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:25:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:25:34 [WARNING ] (13, 1, 'bot')
2019-01-15 03:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:25:34 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-15 03:25:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:26:04 [DEBUG   ] Got command RPT from MCS: ref #1172352
2019-01-15 03:26:04 [DEBUG   ] summary = ERROR
2019-01-15 03:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172352  13 58498 12364889 A  ERRORERROR'
2019-01-15 03:26:04 [DEBUG   ] Got command RPT from MCS: ref #1172353
2019-01-15 03:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172353  77 58498 12364890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:26:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:26:10 [DEBUG   ] Got command RPT from MCS: ref #1172369
2019-01-15 03:26:10 [DEBUG   ] summary = ERROR
2019-01-15 03:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172369  13 58498 12370593 A  ERRORERROR'
2019-01-15 03:26:10 [DEBUG   ] Got command RPT from MCS: ref #1172370
2019-01-15 03:26:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172370  77 58498 12370797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:26:11 [DEBUG   ] Got command RPT from MCS: ref #1172371
2019-01-15 03:26:11 [DEBUG   ] summary = ERROR
2019-01-15 03:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172371  13 58498 12371001 A  ERRORERROR'
2019-01-15 03:26:11 [DEBUG   ] Got command RPT from MCS: ref #1172373
2019-01-15 03:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172373  77 58498 12371193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:26:11 [DEBUG   ] Got command RPT from MCS: ref #1172374
2019-01-15 03:26:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172374  12 58498 12371397 A  ERRORB–™š'
2019-01-15 03:26:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 03:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:26:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:26:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:26:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:26:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:26:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:26:35 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-15 03:26:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:27:11 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-15 03:27:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:27:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:27:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:27:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:27:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:27:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:27:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:27:35 [DEBUG   ] Finished updating board flags in 2.175 seconds
2019-01-15 03:27:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:28:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:28:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:28:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:28:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:28:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:28:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:28:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:28:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:28:35 [DEBUG   ] Finished updating board flags in 2.035 seconds
2019-01-15 03:28:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 03:29:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:29:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:29:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:29:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:29:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:29:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:29:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:29:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:29:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:29:35 [DEBUG   ] Finished updating board flags in 1.970 seconds
2019-01-15 03:29:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 03:30:12 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2019-01-15 03:30:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:30:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:30:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:30:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:30:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:30:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:30:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:30:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:30:35 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-15 03:30:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:31:04 [DEBUG   ] Got command RPT from MCS: ref #1172387
2019-01-15 03:31:04 [DEBUG   ] summary = ERROR
2019-01-15 03:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172387  13 58498 12664897 A  ERRORERROR'
2019-01-15 03:31:04 [DEBUG   ] Got command RPT from MCS: ref #1172388
2019-01-15 03:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172388  77 58498 12664898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:31:10 [DEBUG   ] Got command RPT from MCS: ref #1172404
2019-01-15 03:31:10 [DEBUG   ] summary = ERROR
2019-01-15 03:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172404  13 58498 12670681 A  ERRORERROR'
2019-01-15 03:31:10 [DEBUG   ] Got command RPT from MCS: ref #1172405
2019-01-15 03:31:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172405  77 58498 12670885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:31:11 [DEBUG   ] Got command RPT from MCS: ref #1172406
2019-01-15 03:31:11 [DEBUG   ] summary = ERROR
2019-01-15 03:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172406  13 58498 12671077 A  ERRORERROR'
2019-01-15 03:31:11 [DEBUG   ] Got command RPT from MCS: ref #1172407
2019-01-15 03:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172407  77 58498 12671281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:31:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:31:11 [DEBUG   ] Got command RPT from MCS: ref #1172408
2019-01-15 03:31:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172408  12 58498 12671485 A  ERRORB•™š'
2019-01-15 03:31:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 03:31:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:31:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:31:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:31:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:31:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:31:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:31:35 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-15 03:31:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:32:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:32:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 03:32:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:32:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:32:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:32:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:32:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:32:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:32:35 [DEBUG   ] Finished updating board flags in 1.705 seconds
2019-01-15 03:32:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 03:33:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:33:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:33:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 03:33:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:33:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:33:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:33:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:33:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:33:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:33:35 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-15 03:33:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 03:34:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 03:34:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:34:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:34:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:34:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:34:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:34:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:34:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:34:35 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-15 03:34:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 03:35:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 03:35:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:35:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:35:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:35:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:35:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:35:35 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-15 03:35:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:36:04 [DEBUG   ] Got command RPT from MCS: ref #1172419
2019-01-15 03:36:04 [DEBUG   ] summary = ERROR
2019-01-15 03:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172419  13 58498 12964897 A  ERRORERROR'
2019-01-15 03:36:04 [DEBUG   ] Got command RPT from MCS: ref #1172420
2019-01-15 03:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172420  77 58498 12964898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:36:10 [DEBUG   ] Got command RPT from MCS: ref #1172436
2019-01-15 03:36:10 [DEBUG   ] summary = ERROR
2019-01-15 03:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172436  13 58498 12970765 A  ERRORERROR'
2019-01-15 03:36:10 [DEBUG   ] Got command RPT from MCS: ref #1172437
2019-01-15 03:36:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172437  77 58498 12970957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:36:11 [DEBUG   ] Got command RPT from MCS: ref #1172438
2019-01-15 03:36:11 [DEBUG   ] summary = ERROR
2019-01-15 03:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172438  13 58498 12971162 A  ERRORERROR'
2019-01-15 03:36:11 [DEBUG   ] Got command RPT from MCS: ref #1172440
2019-01-15 03:36:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172440  77 58498 12971365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:36:11 [DEBUG   ] Got command RPT from MCS: ref #1172441
2019-01-15 03:36:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172441  12 58498 12971557 A  ERRORB—™š'
2019-01-15 03:36:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:36:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:36:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:36:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:36:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:36:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:36:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:36:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:36:35 [DEBUG   ] Finished updating board flags in 1.509 seconds
2019-01-15 03:36:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:37:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:37:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 03:37:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 03:37:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:37:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:37:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:37:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:37:35 [WARNING ] (13, 1, 'bot')
2019-01-15 03:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:37:35 [DEBUG   ] Finished updating board flags in 1.509 seconds
2019-01-15 03:37:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 03:38:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:38:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:38:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:38:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:38:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:38:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:38:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:38:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:38:36 [DEBUG   ] Finished updating board flags in 2.201 seconds
2019-01-15 03:38:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 03:39:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 03:39:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:39:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:39:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:39:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:39:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:39:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:39:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:39:36 [DEBUG   ] Finished updating board flags in 2.156 seconds
2019-01-15 03:39:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 03:40:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:40:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 03:40:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:40:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:40:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:40:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:40:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:40:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:40:36 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-15 03:40:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:41:04 [DEBUG   ] Got command RPT from MCS: ref #1172450
2019-01-15 03:41:04 [DEBUG   ] summary = ERROR
2019-01-15 03:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172450  13 58498 13264893 A  ERRORERROR'
2019-01-15 03:41:04 [DEBUG   ] Got command RPT from MCS: ref #1172451
2019-01-15 03:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172451  77 58498 13264894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:41:10 [DEBUG   ] Got command RPT from MCS: ref #1172467
2019-01-15 03:41:10 [DEBUG   ] summary = ERROR
2019-01-15 03:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172467  13 58498 13270845 A  ERRORERROR'
2019-01-15 03:41:11 [DEBUG   ] Got command RPT from MCS: ref #1172468
2019-01-15 03:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172468  77 58498 13271037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:41:11 [DEBUG   ] Got command RPT from MCS: ref #1172469
2019-01-15 03:41:11 [DEBUG   ] summary = ERROR
2019-01-15 03:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172469  13 58498 13271241 A  ERRORERROR'
2019-01-15 03:41:11 [DEBUG   ] Got command RPT from MCS: ref #1172470
2019-01-15 03:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172470  77 58498 13271445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:41:11 [DEBUG   ] Got command RPT from MCS: ref #1172471
2019-01-15 03:41:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172471  12 58498 13271649 A  ERRORB–™š'
2019-01-15 03:41:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:41:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:41:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:41:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:41:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:41:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:41:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:41:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:41:36 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-15 03:41:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 03:42:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:42:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 03:42:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:42:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:42:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:42:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:42:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:42:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:42:36 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-15 03:42:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 03:43:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:43:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:43:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:43:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:43:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:43:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:43:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:43:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:43:36 [DEBUG   ] Finished updating board flags in 1.959 seconds
2019-01-15 03:43:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 03:44:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 03:44:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:44:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:44:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:44:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:44:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:44:36 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 03:44:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 03:45:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:45:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 03:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:45:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:45:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:45:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:45:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:45:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:45:36 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-15 03:45:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 03:46:04 [DEBUG   ] Got command RPT from MCS: ref #1172482
2019-01-15 03:46:04 [DEBUG   ] summary = ERROR
2019-01-15 03:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172482  13 58498 13564897 A  ERRORERROR'
2019-01-15 03:46:04 [DEBUG   ] Got command RPT from MCS: ref #1172483
2019-01-15 03:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172483  77 58498 13564898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:46:10 [DEBUG   ] Got command RPT from MCS: ref #1172499
2019-01-15 03:46:10 [DEBUG   ] summary = ERROR
2019-01-15 03:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172499  13 58498 13570921 A  ERRORERROR'
2019-01-15 03:46:11 [DEBUG   ] Got command RPT from MCS: ref #1172500
2019-01-15 03:46:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172500  77 58498 13571125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:46:11 [DEBUG   ] Got command RPT from MCS: ref #1172501
2019-01-15 03:46:11 [DEBUG   ] summary = ERROR
2019-01-15 03:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172501  13 58498 13571317 A  ERRORERROR'
2019-01-15 03:46:11 [DEBUG   ] Got command RPT from MCS: ref #1172503
2019-01-15 03:46:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172503  77 58498 13571521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:46:11 [DEBUG   ] Got command RPT from MCS: ref #1172504
2019-01-15 03:46:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172504  12 58498 13571725 A  ERRORB–™š'
2019-01-15 03:46:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:46:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 03:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:46:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:46:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:46:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:46:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:46:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:46:36 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 03:46:53 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2019-01-15 03:47:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:47:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:47:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:47:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:47:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:47:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:47:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:47:36 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-15 03:47:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 03:48:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 03:48:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 03:48:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:48:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:48:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:48:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:48:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:48:36 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 03:48:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 03:49:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 03:49:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:49:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:49:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:49:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:49:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:49:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:49:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:49:36 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 03:49:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 03:50:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 03:50:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 03:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:50:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:50:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:50:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:50:36 [WARNING ] (13, 1, 'bot')
2019-01-15 03:50:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:50:36 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-15 03:50:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:51:04 [DEBUG   ] Got command RPT from MCS: ref #1172517
2019-01-15 03:51:04 [DEBUG   ] summary = ERROR
2019-01-15 03:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172517  13 58498 13864901 A  ERRORERROR'
2019-01-15 03:51:04 [DEBUG   ] Got command RPT from MCS: ref #1172518
2019-01-15 03:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172518  77 58498 13864902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:51:10 [DEBUG   ] Got command RPT from MCS: ref #1172534
2019-01-15 03:51:10 [DEBUG   ] summary = ERROR
2019-01-15 03:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172534  13 58498 13870997 A  ERRORERROR'
2019-01-15 03:51:11 [DEBUG   ] Got command RPT from MCS: ref #1172535
2019-01-15 03:51:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172535  77 58498 13871201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:51:11 [DEBUG   ] Got command RPT from MCS: ref #1172536
2019-01-15 03:51:11 [DEBUG   ] summary = ERROR
2019-01-15 03:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172536  13 58498 13871405 A  ERRORERROR'
2019-01-15 03:51:11 [DEBUG   ] Got command RPT from MCS: ref #1172537
2019-01-15 03:51:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172537  77 58498 13871597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:51:11 [DEBUG   ] Got command RPT from MCS: ref #1172538
2019-01-15 03:51:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172538  12 58498 13871801 A  ERRORB—™š'
2019-01-15 03:51:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:51:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 03:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:51:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:51:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:51:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:51:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:51:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:51:37 [DEBUG   ] Finished updating board flags in 2.082 seconds
2019-01-15 03:51:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 03:52:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:52:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 03:52:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 03:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:52:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 03:52:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:52:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:52:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:52:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:52:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:52:37 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-15 03:52:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 03:53:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:53:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:53:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 03:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:53:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 03:53:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:53:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:53:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:53:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:53:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:53:37 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-01-15 03:53:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:54:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 03:54:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 03:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:54:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:54:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:54:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:54:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:54:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:54:37 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-15 03:54:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 03:55:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 03:55:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 03:55:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:55:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 03:55:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:55:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:55:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:55:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:55:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:55:37 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-01-15 03:55:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 03:56:04 [DEBUG   ] Got command RPT from MCS: ref #1172545
2019-01-15 03:56:04 [DEBUG   ] summary = ERROR
2019-01-15 03:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172545  13 58498 14164897 A  ERRORERROR'
2019-01-15 03:56:04 [DEBUG   ] Got command RPT from MCS: ref #1172546
2019-01-15 03:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172546  77 58498 14164898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:56:11 [DEBUG   ] Got command RPT from MCS: ref #1172562
2019-01-15 03:56:11 [DEBUG   ] summary = ERROR
2019-01-15 03:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172562  13 58498 14171077 A  ERRORERROR'
2019-01-15 03:56:11 [DEBUG   ] Got command RPT from MCS: ref #1172563
2019-01-15 03:56:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172563  77 58498 14171281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:56:11 [DEBUG   ] Got command RPT from MCS: ref #1172564
2019-01-15 03:56:11 [DEBUG   ] summary = ERROR
2019-01-15 03:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172564  13 58498 14171485 A  ERRORERROR'
2019-01-15 03:56:11 [DEBUG   ] Got command RPT from MCS: ref #1172566
2019-01-15 03:56:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 03:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172566  77 58498 14171677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 03:56:11 [DEBUG   ] Got command RPT from MCS: ref #1172568
2019-01-15 03:56:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 03:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172568  12 58498 14171881 A  ERRORB—™š'
2019-01-15 03:56:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 03:56:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 03:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:56:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 03:56:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:56:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:56:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:56:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:56:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:56:37 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 03:56:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 03:57:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 03:57:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 03:57:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:57:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:57:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:57:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:57:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:57:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:57:37 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-01-15 03:57:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 03:58:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 03:58:36 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2019-01-15 03:58:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:58:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:58:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:58:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:58:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:58:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:58:37 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-15 03:58:56 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-01-15 03:59:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 03:59:36 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2019-01-15 03:59:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 03:59:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:59:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:59:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:59:37 [WARNING ] (13, 1, 'bot')
2019-01-15 03:59:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 03:59:37 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-15 03:59:56 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2019-01-15 04:00:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 04:00:36 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-01-15 04:00:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:00:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:00:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:00:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:00:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:00:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:00:37 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-01-15 04:00:56 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2019-01-15 04:01:04 [DEBUG   ] Got command RPT from MCS: ref #1172580
2019-01-15 04:01:04 [DEBUG   ] summary = ERROR
2019-01-15 04:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172580  13 58498 14464905 A  ERRORERROR'
2019-01-15 04:01:04 [DEBUG   ] Got command RPT from MCS: ref #1172581
2019-01-15 04:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172581  77 58498 14464906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:01:11 [DEBUG   ] Got command RPT from MCS: ref #1172597
2019-01-15 04:01:11 [DEBUG   ] summary = ERROR
2019-01-15 04:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172597  13 58498 14471157 A  ERRORERROR'
2019-01-15 04:01:11 [DEBUG   ] Got command RPT from MCS: ref #1172598
2019-01-15 04:01:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172598  77 58498 14471361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:01:11 [DEBUG   ] Got command RPT from MCS: ref #1172599
2019-01-15 04:01:11 [DEBUG   ] summary = ERROR
2019-01-15 04:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172599  13 58498 14471565 A  ERRORERROR'
2019-01-15 04:01:11 [DEBUG   ] Got command RPT from MCS: ref #1172600
2019-01-15 04:01:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172600  77 58498 14471757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:01:11 [DEBUG   ] Got command RPT from MCS: ref #1172601
2019-01-15 04:01:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172601  12 58498 14471961 A  ERRORB–™š'
2019-01-15 04:01:17 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 04:01:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:01:37 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2019-01-15 04:01:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:01:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:01:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:01:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:01:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:01:37 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-01-15 04:01:57 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2019-01-15 04:02:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:02:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:02:37 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2019-01-15 04:02:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:02:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:02:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:02:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:02:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:02:37 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-15 04:02:57 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2019-01-15 04:03:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:03:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:03:37 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2019-01-15 04:03:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:03:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:03:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:03:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:03:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:03:37 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-01-15 04:03:57 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2019-01-15 04:04:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:04:37 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2019-01-15 04:04:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:04:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:04:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:04:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:04:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:04:37 [DEBUG   ] Finished updating board flags in 1.447 seconds
2019-01-15 04:04:57 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-15 04:05:18 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 04:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:05:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:05:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:05:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:05:37 [WARNING ] (13, 1, 'bot')
2019-01-15 04:05:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:05:37 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-15 04:05:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 04:05:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 04:06:04 [DEBUG   ] Got command RPT from MCS: ref #1172612
2019-01-15 04:06:04 [DEBUG   ] summary = ERROR
2019-01-15 04:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172612  13 58498 14764905 A  ERRORERROR'
2019-01-15 04:06:04 [DEBUG   ] Got command RPT from MCS: ref #1172613
2019-01-15 04:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172613  77 58498 14764906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:06:11 [DEBUG   ] Got command RPT from MCS: ref #1172629
2019-01-15 04:06:11 [DEBUG   ] summary = ERROR
2019-01-15 04:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172629  13 58498 14771241 A  ERRORERROR'
2019-01-15 04:06:11 [DEBUG   ] Got command RPT from MCS: ref #1172630
2019-01-15 04:06:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172630  77 58498 14771445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:06:11 [DEBUG   ] Got command RPT from MCS: ref #1172631
2019-01-15 04:06:11 [DEBUG   ] summary = ERROR
2019-01-15 04:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172631  13 58498 14771637 A  ERRORERROR'
2019-01-15 04:06:11 [DEBUG   ] Got command RPT from MCS: ref #1172633
2019-01-15 04:06:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172633  77 58498 14771841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:06:12 [DEBUG   ] Got command RPT from MCS: ref #1172634
2019-01-15 04:06:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172634  12 58498 14772050 A  ERRORB•™š'
2019-01-15 04:06:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 04:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:06:38 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-01-15 04:06:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:06:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:06:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:06:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:06:38 [DEBUG   ] Finished updating board flags in 2.204 seconds
2019-01-15 04:06:58 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2019-01-15 04:07:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 04:07:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:07:38 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-15 04:07:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:07:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:07:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:07:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:07:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:07:38 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-01-15 04:07:58 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-15 04:08:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 04:08:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:08:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:08:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:08:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:08:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:08:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:08:38 [DEBUG   ] Finished updating board flags in 2.193 seconds
2019-01-15 04:08:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 04:08:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 04:09:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 04:09:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:09:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:09:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:09:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:09:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:09:38 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-15 04:09:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 04:09:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 04:10:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 04:10:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 04:10:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:10:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:10:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:10:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:10:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:10:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:10:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:10:38 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-15 04:10:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:10:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 04:11:04 [DEBUG   ] Got command RPT from MCS: ref #1172643
2019-01-15 04:11:04 [DEBUG   ] summary = ERROR
2019-01-15 04:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172643  13 58498 15064905 A  ERRORERROR'
2019-01-15 04:11:04 [DEBUG   ] Got command RPT from MCS: ref #1172644
2019-01-15 04:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172644  77 58498 15064906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:11:11 [DEBUG   ] Got command RPT from MCS: ref #1172660
2019-01-15 04:11:11 [DEBUG   ] summary = ERROR
2019-01-15 04:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172660  13 58498 15071325 A  ERRORERROR'
2019-01-15 04:11:11 [DEBUG   ] Got command RPT from MCS: ref #1172661
2019-01-15 04:11:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172661  77 58498 15071517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:11:11 [DEBUG   ] Got command RPT from MCS: ref #1172662
2019-01-15 04:11:11 [DEBUG   ] summary = ERROR
2019-01-15 04:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172662  13 58498 15071721 A  ERRORERROR'
2019-01-15 04:11:11 [DEBUG   ] Got command RPT from MCS: ref #1172663
2019-01-15 04:11:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172663  77 58498 15071925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:11:12 [DEBUG   ] Got command RPT from MCS: ref #1172664
2019-01-15 04:11:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172664  12 58498 15072117 A  ERRORB—™š'
2019-01-15 04:11:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:11:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:11:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:11:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:11:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:11:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:11:39 [DEBUG   ] Finished updating board flags in 2.408 seconds
2019-01-15 04:11:39 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-15 04:11:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 04:12:20 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 04:12:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:12:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:12:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 04:12:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:12:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:12:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:12:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:12:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:12:38 [DEBUG   ] Finished updating board flags in 1.765 seconds
2019-01-15 04:12:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 04:13:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 04:13:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 04:13:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:13:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:13:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:13:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:13:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:13:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:13:38 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-01-15 04:13:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:14:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:14:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:14:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:14:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:14:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:14:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:14:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:14:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:14:38 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 04:14:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 04:15:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:15:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:15:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:15:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:15:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:15:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:15:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:15:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:15:38 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-15 04:15:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:16:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 04:16:04 [DEBUG   ] Got command RPT from MCS: ref #1172675
2019-01-15 04:16:04 [DEBUG   ] summary = ERROR
2019-01-15 04:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172675  13 58498 15364905 A  ERRORERROR'
2019-01-15 04:16:04 [DEBUG   ] Got command RPT from MCS: ref #1172676
2019-01-15 04:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172676  77 58498 15364906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:16:11 [DEBUG   ] Got command RPT from MCS: ref #1172692
2019-01-15 04:16:11 [DEBUG   ] summary = ERROR
2019-01-15 04:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172692  13 58498 15371397 A  ERRORERROR'
2019-01-15 04:16:11 [DEBUG   ] Got command RPT from MCS: ref #1172693
2019-01-15 04:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172693  77 58498 15371601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:16:11 [DEBUG   ] Got command RPT from MCS: ref #1172694
2019-01-15 04:16:11 [DEBUG   ] summary = ERROR
2019-01-15 04:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172694  13 58498 15371805 A  ERRORERROR'
2019-01-15 04:16:11 [DEBUG   ] Got command RPT from MCS: ref #1172696
2019-01-15 04:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172696  77 58498 15371997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:16:12 [DEBUG   ] Got command RPT from MCS: ref #1172698
2019-01-15 04:16:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172698  12 58498 15372201 A  ERRORB—™š'
2019-01-15 04:16:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:16:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:16:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:16:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:16:38 [WARNING ] (13, 1, 'bot')
2019-01-15 04:16:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:16:38 [DEBUG   ] Finished updating board flags in 1.506 seconds
2019-01-15 04:16:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:17:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:17:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 04:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:17:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:17:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:17:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:17:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:17:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:17:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:17:40 [DEBUG   ] Finished updating board flags in 3.003 seconds
2019-01-15 04:18:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 04:18:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 04:18:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:18:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:18:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:18:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:18:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:18:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:18:39 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-01-15 04:18:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 04:19:01 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 04:19:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 04:19:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:19:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 04:19:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:19:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:19:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:19:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:19:39 [DEBUG   ] Finished updating board flags in 2.224 seconds
2019-01-15 04:19:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 04:20:01 [DEBUG   ] Finished updating ant stats in 0.826 seconds
2019-01-15 04:20:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 04:20:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:20:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:20:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:20:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:20:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:20:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:20:39 [DEBUG   ] Finished updating board flags in 1.962 seconds
2019-01-15 04:20:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:21:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 04:21:04 [DEBUG   ] Got command RPT from MCS: ref #1172710
2019-01-15 04:21:04 [DEBUG   ] summary = ERROR
2019-01-15 04:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172710  13 58498 15664901 A  ERRORERROR'
2019-01-15 04:21:04 [DEBUG   ] Got command RPT from MCS: ref #1172711
2019-01-15 04:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172711  77 58498 15664902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:21:11 [DEBUG   ] Got command RPT from MCS: ref #1172727
2019-01-15 04:21:11 [DEBUG   ] summary = ERROR
2019-01-15 04:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172727  13 58498 15671477 A  ERRORERROR'
2019-01-15 04:21:11 [DEBUG   ] Got command RPT from MCS: ref #1172728
2019-01-15 04:21:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172728  77 58498 15671681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:21:11 [DEBUG   ] Got command RPT from MCS: ref #1172729
2019-01-15 04:21:11 [DEBUG   ] summary = ERROR
2019-01-15 04:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172729  13 58498 15671902 A  ERRORERROR'
2019-01-15 04:21:12 [DEBUG   ] Got command RPT from MCS: ref #1172730
2019-01-15 04:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172730  77 58498 15672081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:21:12 [DEBUG   ] Got command RPT from MCS: ref #1172731
2019-01-15 04:21:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172731  12 58498 15672285 A  ERRORB•™š'
2019-01-15 04:21:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:21:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:21:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:21:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:21:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:21:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:21:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:21:39 [DEBUG   ] Finished updating board flags in 1.838 seconds
2019-01-15 04:21:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:22:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:22:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 04:22:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:22:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:22:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:22:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:22:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:22:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:22:39 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-15 04:22:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 04:23:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 04:23:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 04:23:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:23:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:23:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:23:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:23:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:23:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:23:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:23:39 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-01-15 04:23:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 04:24:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 04:24:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 04:24:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:24:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:24:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:24:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:24:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:24:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:24:39 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-15 04:24:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 04:25:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:25:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:25:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:25:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:25:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:25:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:25:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:25:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:25:39 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 04:25:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 04:26:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 04:26:04 [DEBUG   ] Got command RPT from MCS: ref #1172738
2019-01-15 04:26:04 [DEBUG   ] summary = ERROR
2019-01-15 04:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172738  13 58498 15964905 A  ERRORERROR'
2019-01-15 04:26:04 [DEBUG   ] Got command RPT from MCS: ref #1172739
2019-01-15 04:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172739  77 58498 15964906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:26:11 [DEBUG   ] Got command RPT from MCS: ref #1172755
2019-01-15 04:26:11 [DEBUG   ] summary = ERROR
2019-01-15 04:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172755  13 58498 15971565 A  ERRORERROR'
2019-01-15 04:26:11 [DEBUG   ] Got command RPT from MCS: ref #1172756
2019-01-15 04:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172756  77 58498 15971757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:26:11 [DEBUG   ] Got command RPT from MCS: ref #1172757
2019-01-15 04:26:11 [DEBUG   ] summary = ERROR
2019-01-15 04:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172757  13 58498 15971961 A  ERRORERROR'
2019-01-15 04:26:12 [DEBUG   ] Got command RPT from MCS: ref #1172759
2019-01-15 04:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172759  77 58498 15972165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:26:12 [DEBUG   ] Got command RPT from MCS: ref #1172761
2019-01-15 04:26:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172761  12 58498 15972369 A  ERRORB—™š'
2019-01-15 04:26:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:26:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:26:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:26:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 04:26:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:26:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:26:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:26:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:26:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:26:39 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-15 04:26:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:27:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 04:27:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 04:27:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:27:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:27:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:27:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:27:39 [WARNING ] (13, 1, 'bot')
2019-01-15 04:27:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:27:39 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-15 04:27:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:28:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:28:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 04:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:28:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:28:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:28:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:28:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:28:40 [DEBUG   ] Finished updating board flags in 2.104 seconds
2019-01-15 04:28:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:29:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:29:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:29:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:29:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:29:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:29:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:29:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:29:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:29:40 [DEBUG   ] Finished updating board flags in 1.922 seconds
2019-01-15 04:29:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 04:30:02 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-01-15 04:30:23 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-15 04:30:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:30:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:30:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:30:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:30:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:30:40 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-15 04:30:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:31:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:31:04 [DEBUG   ] Got command RPT from MCS: ref #1172773
2019-01-15 04:31:04 [DEBUG   ] summary = ERROR
2019-01-15 04:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172773  13 58498 16264909 A  ERRORERROR'
2019-01-15 04:31:04 [DEBUG   ] Got command RPT from MCS: ref #1172774
2019-01-15 04:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172774  77 58498 16264910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:31:11 [DEBUG   ] Got command RPT from MCS: ref #1172790
2019-01-15 04:31:11 [DEBUG   ] summary = ERROR
2019-01-15 04:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172790  13 58498 16271641 A  ERRORERROR'
2019-01-15 04:31:11 [DEBUG   ] Got command RPT from MCS: ref #1172791
2019-01-15 04:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172791  77 58498 16271845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:31:12 [DEBUG   ] Got command RPT from MCS: ref #1172792
2019-01-15 04:31:12 [DEBUG   ] summary = ERROR
2019-01-15 04:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172792  13 58498 16272049 A  ERRORERROR'
2019-01-15 04:31:12 [DEBUG   ] Got command RPT from MCS: ref #1172793
2019-01-15 04:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172793  77 58498 16272241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:31:12 [DEBUG   ] Got command RPT from MCS: ref #1172794
2019-01-15 04:31:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172794  12 58498 16272445 A  ERRORB—™š'
2019-01-15 04:31:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:31:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:31:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:31:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:31:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:31:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:31:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:31:40 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-15 04:31:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:32:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 04:32:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:32:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:32:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:32:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:32:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:32:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:32:40 [DEBUG   ] Finished updating board flags in 1.642 seconds
2019-01-15 04:32:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 04:33:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 04:33:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 04:33:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:33:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:33:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:33:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:33:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:33:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:33:40 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 04:33:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:34:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 04:34:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:34:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:34:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:34:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:34:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:34:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:34:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:34:40 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 04:34:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 04:35:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:35:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:35:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:35:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:35:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:35:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:35:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:35:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:35:40 [DEBUG   ] Finished updating board flags in 1.561 seconds
2019-01-15 04:35:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:36:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:36:04 [DEBUG   ] Got command RPT from MCS: ref #1172805
2019-01-15 04:36:04 [DEBUG   ] summary = ERROR
2019-01-15 04:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172805  13 58498 16564913 A  ERRORERROR'
2019-01-15 04:36:04 [DEBUG   ] Got command RPT from MCS: ref #1172806
2019-01-15 04:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172806  77 58498 16564914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:36:11 [DEBUG   ] Got command RPT from MCS: ref #1172822
2019-01-15 04:36:11 [DEBUG   ] summary = ERROR
2019-01-15 04:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172822  13 58498 16571717 A  ERRORERROR'
2019-01-15 04:36:11 [DEBUG   ] Got command RPT from MCS: ref #1172823
2019-01-15 04:36:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172823  77 58498 16571926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:36:12 [DEBUG   ] Got command RPT from MCS: ref #1172824
2019-01-15 04:36:12 [DEBUG   ] summary = ERROR
2019-01-15 04:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172824  13 58498 16572129 A  ERRORERROR'
2019-01-15 04:36:12 [DEBUG   ] Got command RPT from MCS: ref #1172826
2019-01-15 04:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172826  77 58498 16572321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:36:12 [DEBUG   ] Got command RPT from MCS: ref #1172827
2019-01-15 04:36:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172827  12 58498 16572525 A  ERRORB–™š'
2019-01-15 04:36:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:36:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:36:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:36:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:36:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:36:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:36:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:36:40 [DEBUG   ] Finished updating board flags in 1.530 seconds
2019-01-15 04:36:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:37:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:37:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 04:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:37:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:37:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:37:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:37:40 [WARNING ] (13, 1, 'bot')
2019-01-15 04:37:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:37:40 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-01-15 04:37:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 04:38:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 04:38:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 04:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:38:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:38:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:38:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:38:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:38:41 [DEBUG   ] Finished updating board flags in 2.197 seconds
2019-01-15 04:38:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 04:39:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 04:39:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 04:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:39:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:39:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:39:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:39:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:39:41 [DEBUG   ] Finished updating board flags in 1.932 seconds
2019-01-15 04:39:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 04:40:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 04:40:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 04:40:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:40:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:40:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:40:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:40:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:40:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:40:41 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-15 04:40:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:41:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 04:41:04 [DEBUG   ] Got command RPT from MCS: ref #1172836
2019-01-15 04:41:04 [DEBUG   ] summary = ERROR
2019-01-15 04:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172836  13 58498 16864913 A  ERRORERROR'
2019-01-15 04:41:04 [DEBUG   ] Got command RPT from MCS: ref #1172837
2019-01-15 04:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172837  77 58498 16864914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:41:11 [DEBUG   ] Got command RPT from MCS: ref #1172853
2019-01-15 04:41:11 [DEBUG   ] summary = ERROR
2019-01-15 04:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172853  13 58498 16871801 A  ERRORERROR'
2019-01-15 04:41:12 [DEBUG   ] Got command RPT from MCS: ref #1172854
2019-01-15 04:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172854  77 58498 16872005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:41:12 [DEBUG   ] Got command RPT from MCS: ref #1172855
2019-01-15 04:41:12 [DEBUG   ] summary = ERROR
2019-01-15 04:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172855  13 58498 16872209 A  ERRORERROR'
2019-01-15 04:41:12 [DEBUG   ] Got command RPT from MCS: ref #1172856
2019-01-15 04:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172856  77 58498 16872413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:41:12 [DEBUG   ] Got command RPT from MCS: ref #1172857
2019-01-15 04:41:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172857  12 58498 16872605 A  ERRORB•™š'
2019-01-15 04:41:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:41:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:41:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:41:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:41:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:41:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:41:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:41:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:41:41 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-15 04:41:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:42:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:42:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 04:42:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:42:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:42:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:42:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:42:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:42:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:42:41 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-15 04:42:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:43:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:43:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:43:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:43:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:43:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:43:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:43:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:43:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:43:41 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-15 04:43:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 04:44:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 04:44:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:44:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:44:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:44:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:44:41 [WARNING ] (13, 1, 'bot')
2019-01-15 04:44:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:44:41 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-15 04:44:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:45:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:45:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:45:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:45:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:45:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:45:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:45:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:45:42 [DEBUG   ] Finished updating board flags in 2.039 seconds
2019-01-15 04:45:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:46:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:46:04 [DEBUG   ] Got command RPT from MCS: ref #1172868
2019-01-15 04:46:04 [DEBUG   ] summary = ERROR
2019-01-15 04:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172868  13 58498 17164913 A  ERRORERROR'
2019-01-15 04:46:04 [DEBUG   ] Got command RPT from MCS: ref #1172869
2019-01-15 04:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172869  77 58498 17164914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:46:11 [DEBUG   ] Got command RPT from MCS: ref #1172885
2019-01-15 04:46:11 [DEBUG   ] summary = ERROR
2019-01-15 04:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172885  13 58498 17171885 A  ERRORERROR'
2019-01-15 04:46:12 [DEBUG   ] Got command RPT from MCS: ref #1172886
2019-01-15 04:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172886  77 58498 17172089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:46:12 [DEBUG   ] Got command RPT from MCS: ref #1172887
2019-01-15 04:46:12 [DEBUG   ] summary = ERROR
2019-01-15 04:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172887  13 58498 17172281 A  ERRORERROR'
2019-01-15 04:46:12 [DEBUG   ] Got command RPT from MCS: ref #1172889
2019-01-15 04:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172889  77 58498 17172485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:46:12 [DEBUG   ] Got command RPT from MCS: ref #1172890
2019-01-15 04:46:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172890  12 58498 17172689 A  ERRORB—™š'
2019-01-15 04:46:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:46:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:46:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:46:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:46:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:46:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:46:42 [DEBUG   ] Finished updating board flags in 2.076 seconds
2019-01-15 04:46:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:47:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:47:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:47:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:47:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:47:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:47:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:47:42 [DEBUG   ] Finished updating board flags in 1.907 seconds
2019-01-15 04:47:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 04:48:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 04:48:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 04:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:48:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:48:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:48:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:48:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:48:42 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-15 04:48:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 04:49:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 04:49:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 04:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:49:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 04:49:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:49:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:49:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:49:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:49:42 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 04:49:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 04:50:05 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-15 04:50:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:50:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:50:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:50:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:50:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:50:42 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-15 04:50:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:51:04 [DEBUG   ] Got command RPT from MCS: ref #1172903
2019-01-15 04:51:04 [DEBUG   ] summary = ERROR
2019-01-15 04:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172903  13 58498 17464913 A  ERRORERROR'
2019-01-15 04:51:04 [DEBUG   ] Got command RPT from MCS: ref #1172904
2019-01-15 04:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172904  77 58498 17464914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:51:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:51:11 [DEBUG   ] Got command RPT from MCS: ref #1172920
2019-01-15 04:51:11 [DEBUG   ] summary = ERROR
2019-01-15 04:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172920  13 58498 17471969 A  ERRORERROR'
2019-01-15 04:51:12 [DEBUG   ] Got command RPT from MCS: ref #1172921
2019-01-15 04:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172921  77 58498 17472161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:51:12 [DEBUG   ] Got command RPT from MCS: ref #1172922
2019-01-15 04:51:12 [DEBUG   ] summary = ERROR
2019-01-15 04:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172922  13 58498 17472365 A  ERRORERROR'
2019-01-15 04:51:12 [DEBUG   ] Got command RPT from MCS: ref #1172923
2019-01-15 04:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172923  77 58498 17472569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:51:12 [DEBUG   ] Got command RPT from MCS: ref #1172924
2019-01-15 04:51:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172924  12 58498 17472773 A  ERRORB–™š'
2019-01-15 04:51:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:51:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:51:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:51:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:51:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:51:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:51:42 [DEBUG   ] Finished updating board flags in 1.637 seconds
2019-01-15 04:51:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:52:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 04:52:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:52:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:52:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:52:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:52:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:52:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:52:42 [DEBUG   ] Finished updating board flags in 1.557 seconds
2019-01-15 04:52:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 04:53:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 04:53:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 04:53:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:53:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:53:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:53:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:53:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:53:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:53:42 [DEBUG   ] Finished updating board flags in 1.453 seconds
2019-01-15 04:53:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 04:54:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 04:54:25 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2019-01-15 04:54:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:54:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:54:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:54:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:54:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:54:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:54:42 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-15 04:54:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 04:55:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 04:55:25 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-15 04:55:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:55:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:55:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:55:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:55:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:55:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:55:42 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-01-15 04:55:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:56:04 [DEBUG   ] Got command RPT from MCS: ref #1172931
2019-01-15 04:56:04 [DEBUG   ] summary = ERROR
2019-01-15 04:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172931  13 58498 17764914 A  ERRORERROR'
2019-01-15 04:56:04 [DEBUG   ] Got command RPT from MCS: ref #1172932
2019-01-15 04:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172932  77 58498 17764914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:56:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:56:12 [DEBUG   ] Got command RPT from MCS: ref #1172948
2019-01-15 04:56:12 [DEBUG   ] summary = ERROR
2019-01-15 04:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172948  13 58498 17772041 A  ERRORERROR'
2019-01-15 04:56:12 [DEBUG   ] Got command RPT from MCS: ref #1172949
2019-01-15 04:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172949  77 58498 17772245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:56:12 [DEBUG   ] Got command RPT from MCS: ref #1172950
2019-01-15 04:56:12 [DEBUG   ] summary = ERROR
2019-01-15 04:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172950  13 58498 17772449 A  ERRORERROR'
2019-01-15 04:56:12 [DEBUG   ] Got command RPT from MCS: ref #1172952
2019-01-15 04:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 04:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172952  77 58498 17772641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 04:56:12 [DEBUG   ] Got command RPT from MCS: ref #1172953
2019-01-15 04:56:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 04:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172953  12 58498 17772845 A  ERRORB•™š'
2019-01-15 04:56:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:56:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:56:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:56:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:56:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:56:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:56:42 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-01-15 04:56:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 04:57:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 04:57:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 04:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:57:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:57:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:57:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:57:42 [WARNING ] (13, 1, 'bot')
2019-01-15 04:57:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:57:42 [DEBUG   ] Finished updating board flags in 1.565 seconds
2019-01-15 04:57:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 04:58:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 04:58:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 04:58:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 04:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:58:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 04:58:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:58:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:58:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:58:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:58:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:58:43 [DEBUG   ] Finished updating board flags in 2.200 seconds
2019-01-15 04:58:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 04:59:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 04:59:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 04:59:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 04:59:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:59:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:59:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:59:43 [WARNING ] (13, 1, 'bot')
2019-01-15 04:59:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 04:59:43 [DEBUG   ] Finished updating board flags in 2.095 seconds
2019-01-15 04:59:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:00:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 05:00:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:00:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:00:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:00:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:00:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:00:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:00:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:00:43 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-15 05:00:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:01:04 [DEBUG   ] Got command RPT from MCS: ref #1172966
2019-01-15 05:01:04 [DEBUG   ] summary = ERROR
2019-01-15 05:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172966  13 58498 18064917 A  ERRORERROR'
2019-01-15 05:01:04 [DEBUG   ] Got command RPT from MCS: ref #1172967
2019-01-15 05:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172967  77 58498 18064918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:01:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 05:01:12 [DEBUG   ] Got command RPT from MCS: ref #1172983
2019-01-15 05:01:12 [DEBUG   ] summary = ERROR
2019-01-15 05:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172983  13 58498 18072129 A  ERRORERROR'
2019-01-15 05:01:12 [DEBUG   ] Got command RPT from MCS: ref #1172984
2019-01-15 05:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172984  77 58498 18072321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:01:12 [DEBUG   ] Got command RPT from MCS: ref #1172985
2019-01-15 05:01:12 [DEBUG   ] summary = ERROR
2019-01-15 05:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172985  13 58498 18072525 A  ERRORERROR'
2019-01-15 05:01:12 [DEBUG   ] Got command RPT from MCS: ref #1172986
2019-01-15 05:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172986  77 58498 18072729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:01:12 [DEBUG   ] Got command RPT from MCS: ref #1172987
2019-01-15 05:01:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1172987  12 58498 18072933 A  ERRORB—™š'
2019-01-15 05:01:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:01:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 05:01:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:01:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:01:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:01:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:01:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:01:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:01:43 [DEBUG   ] Finished updating board flags in 2.038 seconds
2019-01-15 05:01:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:02:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:02:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 05:02:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:02:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:02:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:02:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:02:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:02:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:02:43 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-15 05:02:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 05:03:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 05:03:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 05:03:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:03:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:03:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:03:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:03:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:03:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:03:43 [DEBUG   ] Finished updating board flags in 1.951 seconds
2019-01-15 05:03:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 05:04:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 05:04:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 05:04:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:04:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:04:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:04:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:04:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:04:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:04:43 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 05:04:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 05:05:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 05:05:11 [DEBUG   ] Got command TBW from MCS: ref #1172993
2019-01-15 05:05:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-15 05:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1172993   8 58498 18311206 A  ERROR'
2019-01-15 05:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-15 05:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-15 05:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-15 05:05:14 [DEBUG   ] spawn_process: at 2019-01-15 05:05:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-15 05:05:14 [INFO    ] Finished spawning TBW
2019-01-15 05:05:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:05:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:05:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:05:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:05:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:05:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:05:43 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-15 05:06:04 [DEBUG   ] Got command RPT from MCS: ref #1173002
2019-01-15 05:06:04 [DEBUG   ] summary = ERROR
2019-01-15 05:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173002  13 58498 18364917 A  ERRORERROR'
2019-01-15 05:06:04 [DEBUG   ] Got command RPT from MCS: ref #1173003
2019-01-15 05:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173003  77 58498 18364918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:06:12 [DEBUG   ] Got command RPT from MCS: ref #1173020
2019-01-15 05:06:12 [DEBUG   ] summary = ERROR
2019-01-15 05:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173020  13 58498 18372213 A  ERRORERROR'
2019-01-15 05:06:12 [DEBUG   ] Got command RPT from MCS: ref #1173021
2019-01-15 05:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173021  77 58498 18372405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:06:12 [DEBUG   ] Got command RPT from MCS: ref #1173022
2019-01-15 05:06:12 [DEBUG   ] summary = ERROR
2019-01-15 05:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173022  13 58498 18372609 A  ERRORERROR'
2019-01-15 05:06:12 [DEBUG   ] Got command RPT from MCS: ref #1173024
2019-01-15 05:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173024  77 58498 18372813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:06:13 [DEBUG   ] Got command RPT from MCS: ref #1173026
2019-01-15 05:06:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:06:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173026  12 58498 18373017 A  ERRORB—™š'
2019-01-15 05:06:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:06:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:06:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:06:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:06:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:06:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:06:43 [DEBUG   ] Finished updating board flags in 1.725 seconds
2019-01-15 05:07:02 [INFO    ] __waitForTBW - TBW finished in 108.145 s
2019-01-15 05:07:03 [DEBUG   ] Finished updating ant stats in 0.414 seconds
2019-01-15 05:07:03 [INFO    ] Started antennas statistics background thread
2019-01-15 05:07:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547528825']
2019-01-15 05:07:03 [DEBUG   ] spawn_process: at 2019-01-15 05:07:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547528825']
2019-01-15 05:07:03 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-15 05:07:23 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2019-01-15 05:07:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:07:43 [DEBUG   ] Finished updating ant stats in 0.458 seconds
2019-01-15 05:07:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:07:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:07:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:07:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:07:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:07:43 [DEBUG   ] Finished updating board flags in 1.845 seconds
2019-01-15 05:08:04 [DEBUG   ] Finished updating ant stats in 1.347 seconds
2019-01-15 05:08:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 05:08:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:08:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:08:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:08:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:08:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:08:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:08:43 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-15 05:08:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 05:09:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:09:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:09:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:09:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 05:09:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:09:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:09:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:09:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:09:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:09:43 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-15 05:09:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:10:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:10:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 05:10:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:10:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 05:10:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:10:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:10:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:10:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:10:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:10:43 [DEBUG   ] Finished updating board flags in 1.566 seconds
2019-01-15 05:10:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 05:11:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 05:11:04 [DEBUG   ] Got command RPT from MCS: ref #1173038
2019-01-15 05:11:04 [DEBUG   ] summary = ERROR
2019-01-15 05:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173038  13 58498 18664917 A  ERRORERROR'
2019-01-15 05:11:04 [DEBUG   ] Got command RPT from MCS: ref #1173039
2019-01-15 05:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173039  77 58498 18664918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:11:12 [DEBUG   ] Got command RPT from MCS: ref #1173055
2019-01-15 05:11:12 [DEBUG   ] summary = ERROR
2019-01-15 05:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173055  13 58498 18672285 A  ERRORERROR'
2019-01-15 05:11:12 [DEBUG   ] Got command RPT from MCS: ref #1173056
2019-01-15 05:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173056  77 58498 18672489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:11:12 [DEBUG   ] Got command RPT from MCS: ref #1173057
2019-01-15 05:11:12 [DEBUG   ] summary = ERROR
2019-01-15 05:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173057  13 58498 18672693 A  ERRORERROR'
2019-01-15 05:11:12 [DEBUG   ] Got command RPT from MCS: ref #1173058
2019-01-15 05:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173058  77 58498 18672897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:11:13 [DEBUG   ] Got command RPT from MCS: ref #1173059
2019-01-15 05:11:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173059  12 58498 18673089 A  ERRORB–™š'
2019-01-15 05:11:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 05:11:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:11:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:11:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:11:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:11:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:11:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:11:43 [DEBUG   ] Finished updating board flags in 1.534 seconds
2019-01-15 05:11:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 05:12:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 05:12:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 05:12:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:12:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:12:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:12:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:12:43 [WARNING ] (13, 1, 'bot')
2019-01-15 05:12:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:12:43 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-15 05:12:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 05:13:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 05:13:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 05:13:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:13:44 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-01-15 05:13:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 05:13:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:13:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:13:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:13:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:13:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:13:44 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-15 05:14:04 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-01-15 05:14:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 05:14:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:14:44 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-15 05:14:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:14:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:14:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:14:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:14:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:14:44 [DEBUG   ] Finished updating board flags in 2.131 seconds
2019-01-15 05:15:04 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-15 05:15:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 05:15:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:15:44 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2019-01-15 05:15:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:15:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:15:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:15:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:15:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:15:44 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-15 05:16:04 [DEBUG   ] Got command RPT from MCS: ref #1173070
2019-01-15 05:16:04 [DEBUG   ] summary = ERROR
2019-01-15 05:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173070  13 58498 18964921 A  ERRORERROR'
2019-01-15 05:16:04 [DEBUG   ] Got command RPT from MCS: ref #1173071
2019-01-15 05:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173071  77 58498 18964922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:16:05 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2019-01-15 05:16:12 [DEBUG   ] Got command RPT from MCS: ref #1173087
2019-01-15 05:16:12 [DEBUG   ] summary = ERROR
2019-01-15 05:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173087  13 58498 18972373 A  ERRORERROR'
2019-01-15 05:16:12 [DEBUG   ] Got command RPT from MCS: ref #1173088
2019-01-15 05:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173088  77 58498 18972565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:16:12 [DEBUG   ] Got command RPT from MCS: ref #1173089
2019-01-15 05:16:12 [DEBUG   ] summary = ERROR
2019-01-15 05:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173089  13 58498 18972769 A  ERRORERROR'
2019-01-15 05:16:12 [DEBUG   ] Got command RPT from MCS: ref #1173091
2019-01-15 05:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173091  77 58498 18972973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:16:13 [DEBUG   ] Got command RPT from MCS: ref #1173093
2019-01-15 05:16:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173093  12 58498 18973177 A  ERRORB–™š'
2019-01-15 05:16:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:16:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:16:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 05:16:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:16:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:16:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:16:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:16:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:16:44 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-15 05:16:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:17:05 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2019-01-15 05:17:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:17:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:17:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:17:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:17:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:17:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:17:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:17:44 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-15 05:17:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:18:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 05:18:25 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-15 05:18:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 05:18:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:18:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:18:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:18:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:18:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:18:44 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-15 05:18:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 05:19:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 05:19:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 05:19:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:19:45 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-15 05:19:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:19:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:19:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:19:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:19:45 [DEBUG   ] Finished updating board flags in 2.450 seconds
2019-01-15 05:20:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 05:20:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 05:20:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:20:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:20:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:20:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:20:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:20:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:20:44 [DEBUG   ] Finished updating board flags in 1.693 seconds
2019-01-15 05:20:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 05:21:04 [DEBUG   ] Got command RPT from MCS: ref #1173105
2019-01-15 05:21:04 [DEBUG   ] summary = ERROR
2019-01-15 05:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173105  13 58498 19264918 A  ERRORERROR'
2019-01-15 05:21:04 [DEBUG   ] Got command RPT from MCS: ref #1173106
2019-01-15 05:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173106  77 58498 19264918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:21:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 05:21:12 [DEBUG   ] Got command RPT from MCS: ref #1173122
2019-01-15 05:21:12 [DEBUG   ] summary = ERROR
2019-01-15 05:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173122  13 58498 19272453 A  ERRORERROR'
2019-01-15 05:21:12 [DEBUG   ] Got command RPT from MCS: ref #1173123
2019-01-15 05:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173123  77 58498 19272657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:21:12 [DEBUG   ] Got command RPT from MCS: ref #1173124
2019-01-15 05:21:12 [DEBUG   ] summary = ERROR
2019-01-15 05:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173124  13 58498 19272849 A  ERRORERROR'
2019-01-15 05:21:13 [DEBUG   ] Got command RPT from MCS: ref #1173125
2019-01-15 05:21:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173125  77 58498 19273053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:21:13 [DEBUG   ] Got command RPT from MCS: ref #1173126
2019-01-15 05:21:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173126  12 58498 19273257 A  ERRORB—™š'
2019-01-15 05:21:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 05:21:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:21:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:21:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:21:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:21:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:21:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:21:44 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-01-15 05:21:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 05:22:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:22:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:22:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:22:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:22:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:22:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:22:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:22:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:22:44 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-01-15 05:22:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 05:23:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:23:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:23:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:23:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 05:23:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:23:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:23:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:23:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:23:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:23:44 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-15 05:23:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:24:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 05:24:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 05:24:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:24:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:24:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:24:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:24:44 [WARNING ] (13, 1, 'bot')
2019-01-15 05:24:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:24:44 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-15 05:24:46 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-15 05:25:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 05:25:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 05:25:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:25:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:25:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:25:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:25:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:25:45 [DEBUG   ] Finished updating board flags in 2.261 seconds
2019-01-15 05:25:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 05:26:04 [DEBUG   ] Got command RPT from MCS: ref #1173133
2019-01-15 05:26:04 [DEBUG   ] summary = ERROR
2019-01-15 05:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173133  13 58498 19564917 A  ERRORERROR'
2019-01-15 05:26:04 [DEBUG   ] Got command RPT from MCS: ref #1173134
2019-01-15 05:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173134  77 58498 19564918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:26:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 05:26:12 [DEBUG   ] Got command RPT from MCS: ref #1173150
2019-01-15 05:26:12 [DEBUG   ] summary = ERROR
2019-01-15 05:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173150  13 58498 19572537 A  ERRORERROR'
2019-01-15 05:26:12 [DEBUG   ] Got command RPT from MCS: ref #1173151
2019-01-15 05:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173151  77 58498 19572729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:26:12 [DEBUG   ] Got command RPT from MCS: ref #1173152
2019-01-15 05:26:12 [DEBUG   ] summary = ERROR
2019-01-15 05:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173152  13 58498 19572933 A  ERRORERROR'
2019-01-15 05:26:13 [DEBUG   ] Got command RPT from MCS: ref #1173154
2019-01-15 05:26:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173154  77 58498 19573137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:26:13 [DEBUG   ] Got command RPT from MCS: ref #1173156
2019-01-15 05:26:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173156  12 58498 19573341 A  ERRORB–™š'
2019-01-15 05:26:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 05:26:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:26:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:26:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:26:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:26:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:26:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:26:45 [DEBUG   ] Finished updating board flags in 2.119 seconds
2019-01-15 05:26:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 05:27:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 05:27:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 05:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:27:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:27:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:27:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:27:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:27:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:27:45 [DEBUG   ] Finished updating board flags in 2.070 seconds
2019-01-15 05:27:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 05:28:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 05:28:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 05:28:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:28:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:28:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:28:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:28:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:28:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:28:45 [DEBUG   ] Finished updating board flags in 1.935 seconds
2019-01-15 05:28:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 05:29:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 05:29:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 05:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:29:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:29:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:29:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:29:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:29:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:29:45 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-15 05:29:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 05:30:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 05:30:27 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2019-01-15 05:30:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:30:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:30:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:30:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:30:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:30:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:30:45 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-01-15 05:30:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 05:31:04 [DEBUG   ] Got command RPT from MCS: ref #1173168
2019-01-15 05:31:04 [DEBUG   ] summary = ERROR
2019-01-15 05:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173168  13 58498 19864913 A  ERRORERROR'
2019-01-15 05:31:04 [DEBUG   ] Got command RPT from MCS: ref #1173169
2019-01-15 05:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173169  77 58498 19864914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:31:07 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-15 05:31:12 [DEBUG   ] Got command RPT from MCS: ref #1173185
2019-01-15 05:31:12 [DEBUG   ] summary = ERROR
2019-01-15 05:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173185  13 58498 19872621 A  ERRORERROR'
2019-01-15 05:31:12 [DEBUG   ] Got command RPT from MCS: ref #1173186
2019-01-15 05:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173186  77 58498 19872813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:31:13 [DEBUG   ] Got command RPT from MCS: ref #1173187
2019-01-15 05:31:13 [DEBUG   ] summary = ERROR
2019-01-15 05:31:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173187  13 58498 19873017 A  ERRORERROR'
2019-01-15 05:31:13 [DEBUG   ] Got command RPT from MCS: ref #1173188
2019-01-15 05:31:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:31:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173188  77 58498 19873221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:31:13 [DEBUG   ] Got command RPT from MCS: ref #1173189
2019-01-15 05:31:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:31:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173189  12 58498 19873413 A  ERRORB•™š'
2019-01-15 05:31:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 05:31:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:31:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:31:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:31:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:31:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:31:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:31:45 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 05:31:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:32:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:32:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:32:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:32:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:32:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:32:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:32:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:32:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:32:45 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 05:32:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 05:33:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:33:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:33:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:33:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:33:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:33:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:33:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:33:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:33:45 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-01-15 05:33:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:34:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:34:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:34:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:34:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:34:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:34:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:34:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:34:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:34:45 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-01-15 05:34:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:35:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:35:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:35:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 05:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:35:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:35:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:35:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:35:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:35:46 [DEBUG   ] Finished updating board flags in 1.629 seconds
2019-01-15 05:35:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:36:04 [DEBUG   ] Got command RPT from MCS: ref #1173200
2019-01-15 05:36:04 [DEBUG   ] summary = ERROR
2019-01-15 05:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173200  13 58498 20164921 A  ERRORERROR'
2019-01-15 05:36:04 [DEBUG   ] Got command RPT from MCS: ref #1173201
2019-01-15 05:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173201  77 58498 20164922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:36:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:36:12 [DEBUG   ] Got command RPT from MCS: ref #1173217
2019-01-15 05:36:12 [DEBUG   ] summary = ERROR
2019-01-15 05:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173217  13 58498 20172697 A  ERRORERROR'
2019-01-15 05:36:12 [DEBUG   ] Got command RPT from MCS: ref #1173218
2019-01-15 05:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173218  77 58498 20172901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:36:13 [DEBUG   ] Got command RPT from MCS: ref #1173219
2019-01-15 05:36:13 [DEBUG   ] summary = ERROR
2019-01-15 05:36:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173219  13 58498 20173105 A  ERRORERROR'
2019-01-15 05:36:13 [DEBUG   ] Got command RPT from MCS: ref #1173221
2019-01-15 05:36:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:36:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173221  77 58498 20173297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:36:13 [DEBUG   ] Got command RPT from MCS: ref #1173222
2019-01-15 05:36:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:36:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173222  12 58498 20173501 A  ERRORB•™š'
2019-01-15 05:36:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:36:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:36:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:36:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:36:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:36:45 [WARNING ] (13, 1, 'bot')
2019-01-15 05:36:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:36:45 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-01-15 05:36:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:37:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:37:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:37:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:37:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 05:37:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:37:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:37:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:37:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:37:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:37:46 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-01-15 05:37:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:38:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 05:38:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:38:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:38:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:38:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:38:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:38:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:38:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:38:46 [DEBUG   ] Finished updating board flags in 2.135 seconds
2019-01-15 05:38:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:39:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:39:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:39:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:39:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:39:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:39:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:39:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:39:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:39:46 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-01-15 05:39:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:40:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:40:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:40:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:40:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 05:40:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:40:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:40:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:40:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:40:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:40:46 [DEBUG   ] Finished updating board flags in 1.952 seconds
2019-01-15 05:40:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:41:04 [DEBUG   ] Got command RPT from MCS: ref #1173231
2019-01-15 05:41:04 [DEBUG   ] summary = ERROR
2019-01-15 05:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173231  13 58498 20464921 A  ERRORERROR'
2019-01-15 05:41:04 [DEBUG   ] Got command RPT from MCS: ref #1173232
2019-01-15 05:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173232  77 58498 20464922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:41:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:41:12 [DEBUG   ] Got command RPT from MCS: ref #1173248
2019-01-15 05:41:12 [DEBUG   ] summary = ERROR
2019-01-15 05:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173248  13 58498 20472781 A  ERRORERROR'
2019-01-15 05:41:12 [DEBUG   ] Got command RPT from MCS: ref #1173249
2019-01-15 05:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173249  77 58498 20472985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:41:13 [DEBUG   ] Got command RPT from MCS: ref #1173250
2019-01-15 05:41:13 [DEBUG   ] summary = ERROR
2019-01-15 05:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173250  13 58498 20473177 A  ERRORERROR'
2019-01-15 05:41:13 [DEBUG   ] Got command RPT from MCS: ref #1173251
2019-01-15 05:41:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173251  77 58498 20473381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:41:13 [DEBUG   ] Got command RPT from MCS: ref #1173252
2019-01-15 05:41:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173252  12 58498 20473585 A  ERRORB—™š'
2019-01-15 05:41:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:41:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:41:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:41:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:41:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:41:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:41:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:41:46 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-15 05:41:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:42:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 05:42:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:42:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:42:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:42:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:42:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:42:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:42:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:42:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:42:47 [DEBUG   ] Finished updating board flags in 2.936 seconds
2019-01-15 05:43:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 05:43:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:43:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:43:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:43:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:43:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:43:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:43:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:43:46 [DEBUG   ] Finished updating board flags in 1.644 seconds
2019-01-15 05:43:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:44:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:44:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:44:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:44:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:44:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:44:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:44:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:44:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:44:46 [DEBUG   ] Finished updating board flags in 1.637 seconds
2019-01-15 05:44:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:45:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:45:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:45:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:45:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:45:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:45:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:45:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:45:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:45:46 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-01-15 05:45:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:46:04 [DEBUG   ] Got command RPT from MCS: ref #1173263
2019-01-15 05:46:04 [DEBUG   ] summary = ERROR
2019-01-15 05:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173263  13 58498 20764921 A  ERRORERROR'
2019-01-15 05:46:04 [DEBUG   ] Got command RPT from MCS: ref #1173264
2019-01-15 05:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173264  77 58498 20764922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:46:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:46:12 [DEBUG   ] Got command RPT from MCS: ref #1173280
2019-01-15 05:46:12 [DEBUG   ] summary = ERROR
2019-01-15 05:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173280  13 58498 20772861 A  ERRORERROR'
2019-01-15 05:46:13 [DEBUG   ] Got command RPT from MCS: ref #1173281
2019-01-15 05:46:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173281  77 58498 20773065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:46:13 [DEBUG   ] Got command RPT from MCS: ref #1173282
2019-01-15 05:46:13 [DEBUG   ] summary = ERROR
2019-01-15 05:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173282  13 58498 20773269 A  ERRORERROR'
2019-01-15 05:46:13 [DEBUG   ] Got command RPT from MCS: ref #1173284
2019-01-15 05:46:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173284  77 58498 20773461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:46:13 [DEBUG   ] Got command RPT from MCS: ref #1173285
2019-01-15 05:46:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173285  12 58498 20773665 A  ERRORB•™š'
2019-01-15 05:46:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:46:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:46:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:46:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:46:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:46:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:46:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:46:46 [DEBUG   ] Finished updating board flags in 1.566 seconds
2019-01-15 05:46:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 05:47:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:47:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:47:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:47:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:47:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:47:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:47:46 [WARNING ] (13, 1, 'bot')
2019-01-15 05:47:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:47:46 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-15 05:47:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 05:48:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 05:48:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 05:48:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:48:47 [DEBUG   ] Finished updating ant stats in 1.053 seconds
2019-01-15 05:48:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:48:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:48:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:48:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:48:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:48:47 [DEBUG   ] Finished updating board flags in 2.298 seconds
2019-01-15 05:49:07 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2019-01-15 05:49:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 05:49:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:49:47 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-01-15 05:49:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:49:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:49:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:49:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:49:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:49:47 [DEBUG   ] Finished updating board flags in 2.138 seconds
2019-01-15 05:50:07 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-01-15 05:50:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 05:50:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:50:47 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-01-15 05:50:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:50:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:50:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:50:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:50:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:50:47 [DEBUG   ] Finished updating board flags in 2.017 seconds
2019-01-15 05:51:04 [DEBUG   ] Got command RPT from MCS: ref #1173298
2019-01-15 05:51:04 [DEBUG   ] summary = ERROR
2019-01-15 05:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173298  13 58498 21064917 A  ERRORERROR'
2019-01-15 05:51:04 [DEBUG   ] Got command RPT from MCS: ref #1173299
2019-01-15 05:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173299  77 58498 21064918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:51:07 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-15 05:51:12 [DEBUG   ] Got command RPT from MCS: ref #1173315
2019-01-15 05:51:12 [DEBUG   ] summary = ERROR
2019-01-15 05:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173315  13 58498 21072945 A  ERRORERROR'
2019-01-15 05:51:13 [DEBUG   ] Got command RPT from MCS: ref #1173316
2019-01-15 05:51:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:51:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173316  77 58498 21073137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:51:13 [DEBUG   ] Got command RPT from MCS: ref #1173317
2019-01-15 05:51:13 [DEBUG   ] summary = ERROR
2019-01-15 05:51:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173317  13 58498 21073341 A  ERRORERROR'
2019-01-15 05:51:13 [DEBUG   ] Got command RPT from MCS: ref #1173318
2019-01-15 05:51:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:51:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173318  77 58498 21073545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:51:13 [DEBUG   ] Got command RPT from MCS: ref #1173319
2019-01-15 05:51:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:51:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173319  12 58498 21073749 A  ERRORB•™š'
2019-01-15 05:51:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 05:51:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:51:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:51:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:51:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:51:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:51:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:51:47 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-15 05:51:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 05:52:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:52:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:52:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:52:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:52:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:52:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:52:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:52:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:52:47 [DEBUG   ] Finished updating board flags in 1.964 seconds
2019-01-15 05:52:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:53:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:53:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:53:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:53:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:53:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:53:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:53:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:53:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:53:47 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-15 05:53:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:54:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:54:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:54:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 05:54:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:54:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:54:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:54:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:54:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:54:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:54:47 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-15 05:54:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:55:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:55:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:55:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:55:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 05:55:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:55:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:55:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:55:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:55:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:55:47 [DEBUG   ] Finished updating board flags in 1.645 seconds
2019-01-15 05:55:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:56:04 [DEBUG   ] Got command RPT from MCS: ref #1173326
2019-01-15 05:56:04 [DEBUG   ] summary = ERROR
2019-01-15 05:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173326  13 58498 21364921 A  ERRORERROR'
2019-01-15 05:56:04 [DEBUG   ] Got command RPT from MCS: ref #1173327
2019-01-15 05:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173327  77 58498 21364922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:56:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:56:13 [DEBUG   ] Got command RPT from MCS: ref #1173343
2019-01-15 05:56:13 [DEBUG   ] summary = ERROR
2019-01-15 05:56:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173343  13 58498 21373021 A  ERRORERROR'
2019-01-15 05:56:13 [DEBUG   ] Got command RPT from MCS: ref #1173344
2019-01-15 05:56:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:56:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173344  77 58498 21373225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:56:13 [DEBUG   ] Got command RPT from MCS: ref #1173345
2019-01-15 05:56:13 [DEBUG   ] summary = ERROR
2019-01-15 05:56:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173345  13 58498 21373417 A  ERRORERROR'
2019-01-15 05:56:13 [DEBUG   ] Got command RPT from MCS: ref #1173347
2019-01-15 05:56:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 05:56:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173347  77 58498 21373621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 05:56:13 [DEBUG   ] Got command RPT from MCS: ref #1173349
2019-01-15 05:56:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 05:56:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173349  12 58498 21373825 A  ERRORB—™š'
2019-01-15 05:56:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:56:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:56:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:56:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:56:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:56:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:56:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:56:47 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-15 05:56:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:57:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:57:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 05:57:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:57:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:57:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:57:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:57:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:57:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:57:47 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-15 05:57:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:58:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:58:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 05:58:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:58:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:58:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:58:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:58:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:58:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:58:47 [DEBUG   ] Finished updating board flags in 1.642 seconds
2019-01-15 05:58:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 05:59:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 05:59:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 05:59:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 05:59:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:59:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:59:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:59:47 [WARNING ] (13, 1, 'bot')
2019-01-15 05:59:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 05:59:47 [DEBUG   ] Finished updating board flags in 1.659 seconds
2019-01-15 05:59:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:00:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:00:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:00:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:00:47 [WARNING ] (13, 1, 'bot')
2019-01-15 06:00:47 [WARNING ] (13, 1, 'bot')
2019-01-15 06:00:47 [WARNING ] (13, 1, 'bot')
2019-01-15 06:00:47 [WARNING ] (13, 1, 'bot')
2019-01-15 06:00:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:00:47 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-01-15 06:00:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:01:04 [DEBUG   ] Got command RPT from MCS: ref #1173361
2019-01-15 06:01:04 [DEBUG   ] summary = ERROR
2019-01-15 06:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173361  13 58498 21664925 A  ERRORERROR'
2019-01-15 06:01:04 [DEBUG   ] Got command RPT from MCS: ref #1173362
2019-01-15 06:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173362  77 58498 21664926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:01:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:01:13 [DEBUG   ] Got command RPT from MCS: ref #1173378
2019-01-15 06:01:13 [DEBUG   ] summary = ERROR
2019-01-15 06:01:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173378  13 58498 21673097 A  ERRORERROR'
2019-01-15 06:01:13 [DEBUG   ] Got command RPT from MCS: ref #1173379
2019-01-15 06:01:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:01:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173379  77 58498 21673301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:01:13 [DEBUG   ] Got command RPT from MCS: ref #1173380
2019-01-15 06:01:13 [DEBUG   ] summary = ERROR
2019-01-15 06:01:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173380  13 58498 21673505 A  ERRORERROR'
2019-01-15 06:01:13 [DEBUG   ] Got command RPT from MCS: ref #1173381
2019-01-15 06:01:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:01:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173381  77 58498 21673697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:01:13 [DEBUG   ] Got command RPT from MCS: ref #1173382
2019-01-15 06:01:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:01:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173382  12 58498 21673901 A  ERRORB–™š'
2019-01-15 06:01:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:01:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:01:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:01:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:01:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:01:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:01:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:01:48 [DEBUG   ] Finished updating board flags in 1.676 seconds
2019-01-15 06:01:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:02:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 06:02:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 06:02:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:02:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:02:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:02:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:02:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:02:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:02:48 [DEBUG   ] Finished updating board flags in 1.661 seconds
2019-01-15 06:02:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:03:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:03:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 06:03:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:03:48 [DEBUG   ] Finished updating ant stats in 1.056 seconds
2019-01-15 06:03:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:03:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:03:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:03:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:03:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:03:48 [DEBUG   ] Finished updating board flags in 2.340 seconds
2019-01-15 06:04:08 [DEBUG   ] Finished updating ant stats in 0.946 seconds
2019-01-15 06:04:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:04:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:04:48 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-01-15 06:04:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 06:04:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:04:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:04:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:04:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:04:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:04:48 [DEBUG   ] Finished updating board flags in 2.064 seconds
2019-01-15 06:05:08 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2019-01-15 06:05:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 06:05:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:05:48 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-01-15 06:05:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:05:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:05:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:05:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:05:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:05:48 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-15 06:06:04 [DEBUG   ] Got command RPT from MCS: ref #1173393
2019-01-15 06:06:04 [DEBUG   ] summary = ERROR
2019-01-15 06:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173393  13 58498 21964929 A  ERRORERROR'
2019-01-15 06:06:04 [DEBUG   ] Got command RPT from MCS: ref #1173394
2019-01-15 06:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173394  77 58498 21964930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:06:08 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-01-15 06:06:13 [DEBUG   ] Got command RPT from MCS: ref #1173410
2019-01-15 06:06:13 [DEBUG   ] summary = ERROR
2019-01-15 06:06:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173410  13 58498 21973181 A  ERRORERROR'
2019-01-15 06:06:13 [DEBUG   ] Got command RPT from MCS: ref #1173411
2019-01-15 06:06:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:06:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173411  77 58498 21973385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:06:13 [DEBUG   ] Got command RPT from MCS: ref #1173412
2019-01-15 06:06:13 [DEBUG   ] summary = ERROR
2019-01-15 06:06:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173412  13 58498 21973577 A  ERRORERROR'
2019-01-15 06:06:13 [DEBUG   ] Got command RPT from MCS: ref #1173414
2019-01-15 06:06:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:06:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173414  77 58498 21973781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:06:13 [DEBUG   ] Got command RPT from MCS: ref #1173416
2019-01-15 06:06:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:06:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173416  12 58498 21973985 A  ERRORB•™š'
2019-01-15 06:06:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 06:06:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:06:48 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2019-01-15 06:06:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:06:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:06:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:06:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:06:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:06:48 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-15 06:07:09 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2019-01-15 06:07:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 06:07:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:07:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:07:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:07:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:07:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:07:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:07:48 [DEBUG   ] Finished updating board flags in 1.770 seconds
2019-01-15 06:07:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:08:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:08:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:08:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:08:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:08:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:08:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:08:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:08:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:08:48 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 06:08:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 06:09:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:09:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:09:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:09:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:09:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:09:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:09:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:09:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:09:48 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-15 06:09:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:10:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 06:10:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:10:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:10:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:10:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:10:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:10:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:10:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:10:48 [DEBUG   ] Finished updating board flags in 1.641 seconds
2019-01-15 06:10:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:11:04 [DEBUG   ] Got command RPT from MCS: ref #1173424
2019-01-15 06:11:04 [DEBUG   ] summary = ERROR
2019-01-15 06:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173424  13 58498 22264929 A  ERRORERROR'
2019-01-15 06:11:04 [DEBUG   ] Got command RPT from MCS: ref #1173425
2019-01-15 06:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173425  77 58498 22264930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:11:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 06:11:13 [DEBUG   ] Got command RPT from MCS: ref #1173441
2019-01-15 06:11:13 [DEBUG   ] summary = ERROR
2019-01-15 06:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173441  13 58498 22273257 A  ERRORERROR'
2019-01-15 06:11:13 [DEBUG   ] Got command RPT from MCS: ref #1173442
2019-01-15 06:11:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173442  77 58498 22273461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:11:13 [DEBUG   ] Got command RPT from MCS: ref #1173443
2019-01-15 06:11:13 [DEBUG   ] summary = ERROR
2019-01-15 06:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173443  13 58498 22273665 A  ERRORERROR'
2019-01-15 06:11:13 [DEBUG   ] Got command RPT from MCS: ref #1173444
2019-01-15 06:11:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173444  77 58498 22273869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:11:14 [DEBUG   ] Got command RPT from MCS: ref #1173445
2019-01-15 06:11:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173445  12 58498 22274061 A  ERRORB–™š'
2019-01-15 06:11:29 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-15 06:11:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:11:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:11:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:11:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:11:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:11:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:11:48 [DEBUG   ] Finished updating board flags in 1.568 seconds
2019-01-15 06:11:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:12:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:12:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 06:12:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:12:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 06:12:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:12:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:12:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:12:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:12:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:12:48 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-01-15 06:12:49 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2019-01-15 06:13:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:13:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:13:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:13:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 06:13:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:13:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:13:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:13:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:13:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:13:48 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-01-15 06:13:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:14:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 06:14:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:14:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:14:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 06:14:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:14:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:14:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:14:48 [WARNING ] (13, 1, 'bot')
2019-01-15 06:14:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:14:48 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-15 06:14:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:15:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 06:15:29 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-15 06:15:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:15:49 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-15 06:15:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:15:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:15:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:15:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:15:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:15:49 [DEBUG   ] Finished updating board flags in 2.158 seconds
2019-01-15 06:16:04 [DEBUG   ] Got command RPT from MCS: ref #1173456
2019-01-15 06:16:04 [DEBUG   ] summary = ERROR
2019-01-15 06:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173456  13 58498 22564929 A  ERRORERROR'
2019-01-15 06:16:04 [DEBUG   ] Got command RPT from MCS: ref #1173457
2019-01-15 06:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173457  77 58498 22564930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:16:09 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-01-15 06:16:13 [DEBUG   ] Got command RPT from MCS: ref #1173473
2019-01-15 06:16:13 [DEBUG   ] summary = ERROR
2019-01-15 06:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173473  13 58498 22573345 A  ERRORERROR'
2019-01-15 06:16:13 [DEBUG   ] Got command RPT from MCS: ref #1173474
2019-01-15 06:16:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173474  77 58498 22573537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:16:13 [DEBUG   ] Got command RPT from MCS: ref #1173475
2019-01-15 06:16:13 [DEBUG   ] summary = ERROR
2019-01-15 06:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173475  13 58498 22573741 A  ERRORERROR'
2019-01-15 06:16:13 [DEBUG   ] Got command RPT from MCS: ref #1173477
2019-01-15 06:16:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173477  77 58498 22573945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:16:14 [DEBUG   ] Got command RPT from MCS: ref #1173478
2019-01-15 06:16:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:16:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173478  12 58498 22574149 A  ERRORB—™š'
2019-01-15 06:16:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 06:16:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:16:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 06:16:49 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2019-01-15 06:16:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:16:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:16:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:16:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:16:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:16:49 [DEBUG   ] Finished updating board flags in 1.948 seconds
2019-01-15 06:17:10 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2019-01-15 06:17:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 06:17:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:17:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:17:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:17:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:17:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:17:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:17:49 [DEBUG   ] Finished updating board flags in 1.865 seconds
2019-01-15 06:17:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:18:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:18:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:18:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:18:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:18:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:18:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:18:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:18:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:18:49 [DEBUG   ] Finished updating board flags in 1.746 seconds
2019-01-15 06:18:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:19:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:19:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:19:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:19:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 06:19:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:19:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:19:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:19:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:19:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:19:49 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-15 06:19:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:20:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:20:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:20:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:20:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:20:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:20:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:20:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:20:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:20:49 [DEBUG   ] Finished updating board flags in 1.651 seconds
2019-01-15 06:20:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:21:04 [DEBUG   ] Got command RPT from MCS: ref #1173491
2019-01-15 06:21:04 [DEBUG   ] summary = ERROR
2019-01-15 06:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173491  13 58498 22864929 A  ERRORERROR'
2019-01-15 06:21:04 [DEBUG   ] Got command RPT from MCS: ref #1173492
2019-01-15 06:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173492  77 58498 22864930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:21:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 06:21:13 [DEBUG   ] Got command RPT from MCS: ref #1173508
2019-01-15 06:21:13 [DEBUG   ] summary = ERROR
2019-01-15 06:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173508  13 58498 22873425 A  ERRORERROR'
2019-01-15 06:21:13 [DEBUG   ] Got command RPT from MCS: ref #1173509
2019-01-15 06:21:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173509  77 58498 22873617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:21:13 [DEBUG   ] Got command RPT from MCS: ref #1173510
2019-01-15 06:21:13 [DEBUG   ] summary = ERROR
2019-01-15 06:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173510  13 58498 22873821 A  ERRORERROR'
2019-01-15 06:21:14 [DEBUG   ] Got command RPT from MCS: ref #1173511
2019-01-15 06:21:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173511  77 58498 22874025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:21:14 [DEBUG   ] Got command RPT from MCS: ref #1173512
2019-01-15 06:21:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173512  12 58498 22874229 A  ERRORB–™š'
2019-01-15 06:21:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 06:21:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:21:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:21:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:21:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:21:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:21:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:21:49 [DEBUG   ] Finished updating board flags in 1.539 seconds
2019-01-15 06:21:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 06:22:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:22:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 06:22:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:22:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 06:22:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:22:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:22:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:22:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:22:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:22:49 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-15 06:22:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:23:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:23:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:23:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:23:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:23:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:23:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:23:49 [WARNING ] (13, 1, 'bot')
2019-01-15 06:23:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:23:49 [DEBUG   ] Finished updating board flags in 1.544 seconds
2019-01-15 06:23:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 06:24:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:24:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:24:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:24:50 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-01-15 06:24:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:24:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:24:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:24:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:24:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:24:50 [DEBUG   ] Finished updating board flags in 2.244 seconds
2019-01-15 06:25:10 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2019-01-15 06:25:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 06:25:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:25:50 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2019-01-15 06:25:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:25:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:25:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:25:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:25:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:25:50 [DEBUG   ] Finished updating board flags in 2.132 seconds
2019-01-15 06:26:04 [DEBUG   ] Got command RPT from MCS: ref #1173519
2019-01-15 06:26:04 [DEBUG   ] summary = ERROR
2019-01-15 06:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173519  13 58498 23164925 A  ERRORERROR'
2019-01-15 06:26:04 [DEBUG   ] Got command RPT from MCS: ref #1173520
2019-01-15 06:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173520  77 58498 23164926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:26:10 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-15 06:26:13 [DEBUG   ] Got command RPT from MCS: ref #1173536
2019-01-15 06:26:13 [DEBUG   ] summary = ERROR
2019-01-15 06:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173536  13 58498 23173497 A  ERRORERROR'
2019-01-15 06:26:13 [DEBUG   ] Got command RPT from MCS: ref #1173537
2019-01-15 06:26:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173537  77 58498 23173701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:26:13 [DEBUG   ] Got command RPT from MCS: ref #1173538
2019-01-15 06:26:13 [DEBUG   ] summary = ERROR
2019-01-15 06:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173538  13 58498 23173910 A  ERRORERROR'
2019-01-15 06:26:14 [DEBUG   ] Got command RPT from MCS: ref #1173540
2019-01-15 06:26:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173540  77 58498 23174105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:26:14 [DEBUG   ] Got command RPT from MCS: ref #1173541
2019-01-15 06:26:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173541  12 58498 23174305 A  ERRORB•™š'
2019-01-15 06:26:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 06:26:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:26:50 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2019-01-15 06:26:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:26:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:26:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:26:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:26:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:26:50 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-01-15 06:27:11 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2019-01-15 06:27:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:27:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:27:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 06:27:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:27:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:27:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:27:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:27:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:27:50 [DEBUG   ] Finished updating board flags in 1.962 seconds
2019-01-15 06:27:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:28:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 06:28:31 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-15 06:28:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:28:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:28:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:28:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:28:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:28:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:28:50 [DEBUG   ] Finished updating board flags in 1.839 seconds
2019-01-15 06:28:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:29:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:29:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:29:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:29:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-15 06:29:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:29:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:29:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:29:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:29:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:29:50 [DEBUG   ] Finished updating board flags in 1.835 seconds
2019-01-15 06:29:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:30:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:30:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:30:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:30:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:30:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:30:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:30:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:30:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:30:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:30:51 [DEBUG   ] Finished updating board flags in 2.675 seconds
2019-01-15 06:31:04 [DEBUG   ] Got command RPT from MCS: ref #1173554
2019-01-15 06:31:04 [DEBUG   ] summary = ERROR
2019-01-15 06:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173554  13 58498 23464925 A  ERRORERROR'
2019-01-15 06:31:04 [DEBUG   ] Got command RPT from MCS: ref #1173555
2019-01-15 06:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173555  77 58498 23464926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:31:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:31:13 [DEBUG   ] Got command RPT from MCS: ref #1173571
2019-01-15 06:31:13 [DEBUG   ] summary = ERROR
2019-01-15 06:31:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173571  13 58498 23473581 A  ERRORERROR'
2019-01-15 06:31:13 [DEBUG   ] Got command RPT from MCS: ref #1173572
2019-01-15 06:31:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:31:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173572  77 58498 23473785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:31:13 [DEBUG   ] Got command RPT from MCS: ref #1173573
2019-01-15 06:31:13 [DEBUG   ] summary = ERROR
2019-01-15 06:31:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173573  13 58498 23473977 A  ERRORERROR'
2019-01-15 06:31:14 [DEBUG   ] Got command RPT from MCS: ref #1173574
2019-01-15 06:31:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173574  77 58498 23474181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:31:14 [DEBUG   ] Got command RPT from MCS: ref #1173575
2019-01-15 06:31:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173575  12 58498 23474385 A  ERRORB—™š'
2019-01-15 06:31:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:31:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:31:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:31:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:31:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:31:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:31:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:31:50 [DEBUG   ] Finished updating board flags in 1.690 seconds
2019-01-15 06:31:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:32:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:32:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:32:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:32:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:32:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:32:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:32:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:32:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:32:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:32:51 [DEBUG   ] Finished updating board flags in 2.535 seconds
2019-01-15 06:33:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:33:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:33:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 06:33:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:33:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:33:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:33:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:33:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:33:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:33:50 [DEBUG   ] Finished updating board flags in 1.527 seconds
2019-01-15 06:33:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:34:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:34:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:34:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:34:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:34:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:34:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:34:50 [WARNING ] (13, 1, 'bot')
2019-01-15 06:34:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:34:50 [DEBUG   ] Finished updating board flags in 1.547 seconds
2019-01-15 06:34:51 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-15 06:35:11 [DEBUG   ] Finished updating ant stats in 0.817 seconds
2019-01-15 06:35:31 [DEBUG   ] Finished updating ant stats in 0.787 seconds
2019-01-15 06:35:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:35:51 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-01-15 06:35:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:35:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:35:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:35:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:35:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:35:51 [DEBUG   ] Finished updating board flags in 2.209 seconds
2019-01-15 06:36:04 [DEBUG   ] Got command RPT from MCS: ref #1173586
2019-01-15 06:36:04 [DEBUG   ] summary = ERROR
2019-01-15 06:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173586  13 58498 23764929 A  ERRORERROR'
2019-01-15 06:36:04 [DEBUG   ] Got command RPT from MCS: ref #1173587
2019-01-15 06:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173587  77 58498 23764930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:36:11 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-01-15 06:36:13 [DEBUG   ] Got command RPT from MCS: ref #1173603
2019-01-15 06:36:13 [DEBUG   ] summary = ERROR
2019-01-15 06:36:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173603  13 58498 23773665 A  ERRORERROR'
2019-01-15 06:36:13 [DEBUG   ] Got command RPT from MCS: ref #1173604
2019-01-15 06:36:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:36:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173604  77 58498 23773857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:36:14 [DEBUG   ] Got command RPT from MCS: ref #1173605
2019-01-15 06:36:14 [DEBUG   ] summary = ERROR
2019-01-15 06:36:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173605  13 58498 23774061 A  ERRORERROR'
2019-01-15 06:36:14 [DEBUG   ] Got command RPT from MCS: ref #1173607
2019-01-15 06:36:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:36:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173607  77 58498 23774265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:36:14 [DEBUG   ] Got command RPT from MCS: ref #1173609
2019-01-15 06:36:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:36:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173609  12 58498 23774469 A  ERRORB–™š'
2019-01-15 06:36:31 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-15 06:36:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:36:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:36:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:36:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:36:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:36:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:36:51 [DEBUG   ] Finished updating board flags in 2.188 seconds
2019-01-15 06:36:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 06:37:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 06:37:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:37:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:37:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:37:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:37:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:37:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:37:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:37:51 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-15 06:37:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 06:38:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:38:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:38:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:38:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:38:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:38:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:38:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:38:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:38:51 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-01-15 06:38:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:39:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 06:39:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:39:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:39:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:39:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:39:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:39:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:39:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:39:51 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-15 06:39:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:40:12 [DEBUG   ] Finished updating ant stats in 1.458 seconds
2019-01-15 06:40:32 [DEBUG   ] Finished updating ant stats in 1.147 seconds
2019-01-15 06:40:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:40:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:40:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:40:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:40:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:40:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:40:51 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-15 06:40:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:41:04 [DEBUG   ] Got command RPT from MCS: ref #1173617
2019-01-15 06:41:04 [DEBUG   ] summary = ERROR
2019-01-15 06:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173617  13 58498 24064925 A  ERRORERROR'
2019-01-15 06:41:04 [DEBUG   ] Got command RPT from MCS: ref #1173618
2019-01-15 06:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173618  77 58498 24064926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:41:12 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-15 06:41:13 [DEBUG   ] Got command RPT from MCS: ref #1173634
2019-01-15 06:41:13 [DEBUG   ] summary = ERROR
2019-01-15 06:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173634  13 58498 24073737 A  ERRORERROR'
2019-01-15 06:41:13 [DEBUG   ] Got command RPT from MCS: ref #1173635
2019-01-15 06:41:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173635  77 58498 24073941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:41:14 [DEBUG   ] Got command RPT from MCS: ref #1173636
2019-01-15 06:41:14 [DEBUG   ] summary = ERROR
2019-01-15 06:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173636  13 58498 24074145 A  ERRORERROR'
2019-01-15 06:41:14 [DEBUG   ] Got command RPT from MCS: ref #1173637
2019-01-15 06:41:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173637  77 58498 24074337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:41:14 [DEBUG   ] Got command RPT from MCS: ref #1173638
2019-01-15 06:41:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173638  12 58498 24074541 A  ERRORB–™š'
2019-01-15 06:41:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:41:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:41:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:41:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:41:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:41:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:41:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:41:51 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-15 06:41:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:42:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:42:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:42:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:42:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:42:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:42:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:42:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:42:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:42:51 [DEBUG   ] Finished updating board flags in 1.534 seconds
2019-01-15 06:42:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:43:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 06:43:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 06:43:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:43:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:43:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:43:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:43:51 [WARNING ] (13, 1, 'bot')
2019-01-15 06:43:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:43:51 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-01-15 06:43:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 06:44:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 06:44:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 06:44:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:44:52 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2019-01-15 06:44:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:44:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:44:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:44:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:44:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:44:52 [DEBUG   ] Finished updating board flags in 2.168 seconds
2019-01-15 06:45:12 [DEBUG   ] Finished updating ant stats in 0.771 seconds
2019-01-15 06:45:32 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2019-01-15 06:45:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:45:52 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2019-01-15 06:45:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:45:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:45:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:45:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:45:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:45:52 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-15 06:46:04 [DEBUG   ] Got command RPT from MCS: ref #1173649
2019-01-15 06:46:04 [DEBUG   ] summary = ERROR
2019-01-15 06:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173649  13 58498 24364937 A  ERRORERROR'
2019-01-15 06:46:04 [DEBUG   ] Got command RPT from MCS: ref #1173650
2019-01-15 06:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173650  77 58498 24364938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:46:13 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2019-01-15 06:46:13 [DEBUG   ] Got command RPT from MCS: ref #1173666
2019-01-15 06:46:13 [DEBUG   ] summary = ERROR
2019-01-15 06:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173666  13 58498 24373821 A  ERRORERROR'
2019-01-15 06:46:14 [DEBUG   ] Got command RPT from MCS: ref #1173667
2019-01-15 06:46:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173667  77 58498 24374025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:46:14 [DEBUG   ] Got command RPT from MCS: ref #1173668
2019-01-15 06:46:14 [DEBUG   ] summary = ERROR
2019-01-15 06:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173668  13 58498 24374217 A  ERRORERROR'
2019-01-15 06:46:14 [DEBUG   ] Got command RPT from MCS: ref #1173670
2019-01-15 06:46:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173670  77 58498 24374421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:46:14 [DEBUG   ] Got command RPT from MCS: ref #1173671
2019-01-15 06:46:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173671  12 58498 24374625 A  ERRORB•™š'
2019-01-15 06:46:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:46:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:46:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:46:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:46:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:46:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:46:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:46:52 [DEBUG   ] Finished updating board flags in 1.921 seconds
2019-01-15 06:46:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:47:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:47:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:47:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:47:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 06:47:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:47:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:47:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:47:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:47:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:47:52 [DEBUG   ] Finished updating board flags in 1.871 seconds
2019-01-15 06:47:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:48:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 06:48:33 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-15 06:48:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:48:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:48:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:48:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:48:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:48:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:48:52 [DEBUG   ] Finished updating board flags in 1.751 seconds
2019-01-15 06:48:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 06:49:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 06:49:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 06:49:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:49:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:49:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:49:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:49:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:49:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:49:52 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-15 06:49:53 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-15 06:50:13 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-01-15 06:50:33 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-01-15 06:50:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:50:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:50:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:50:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:50:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:50:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:50:52 [DEBUG   ] Finished updating board flags in 1.555 seconds
2019-01-15 06:50:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 06:51:04 [DEBUG   ] Got command RPT from MCS: ref #1173684
2019-01-15 06:51:04 [DEBUG   ] summary = ERROR
2019-01-15 06:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173684  13 58498 24664937 A  ERRORERROR'
2019-01-15 06:51:04 [DEBUG   ] Got command RPT from MCS: ref #1173685
2019-01-15 06:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173685  77 58498 24664938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:51:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 06:51:13 [DEBUG   ] Got command RPT from MCS: ref #1173701
2019-01-15 06:51:13 [DEBUG   ] summary = ERROR
2019-01-15 06:51:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173701  13 58498 24673913 A  ERRORERROR'
2019-01-15 06:51:14 [DEBUG   ] Got command RPT from MCS: ref #1173702
2019-01-15 06:51:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173702  77 58498 24674105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:51:14 [DEBUG   ] Got command RPT from MCS: ref #1173703
2019-01-15 06:51:14 [DEBUG   ] summary = ERROR
2019-01-15 06:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173703  13 58498 24674297 A  ERRORERROR'
2019-01-15 06:51:14 [DEBUG   ] Got command RPT from MCS: ref #1173704
2019-01-15 06:51:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173704  77 58498 24674501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:51:14 [DEBUG   ] Got command RPT from MCS: ref #1173705
2019-01-15 06:51:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173705  12 58498 24674705 A  ERRORB—™š'
2019-01-15 06:51:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 06:51:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:51:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:51:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:51:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:51:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:51:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:51:52 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-15 06:51:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 06:52:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 06:52:34 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 06:52:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 06:52:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:52:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:52:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:52:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:52:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:52:52 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-15 06:52:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 06:53:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:53:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 06:53:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:53:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:53:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:53:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:53:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:53:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:53:52 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-15 06:53:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:54:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 06:54:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 06:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:54:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 06:54:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:54:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:54:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:54:52 [WARNING ] (13, 1, 'bot')
2019-01-15 06:54:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:54:52 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-15 06:54:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 06:55:14 [DEBUG   ] Finished updating ant stats in 1.227 seconds
2019-01-15 06:55:34 [DEBUG   ] Finished updating ant stats in 0.976 seconds
2019-01-15 06:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:55:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:55:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:55:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:55:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:55:53 [DEBUG   ] Finished updating board flags in 2.083 seconds
2019-01-15 06:55:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 06:56:04 [DEBUG   ] Got command RPT from MCS: ref #1173712
2019-01-15 06:56:04 [DEBUG   ] summary = ERROR
2019-01-15 06:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173712  13 58498 24964929 A  ERRORERROR'
2019-01-15 06:56:04 [DEBUG   ] Got command RPT from MCS: ref #1173713
2019-01-15 06:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173713  77 58498 24964930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:56:13 [DEBUG   ] Got command RPT from MCS: ref #1173729
2019-01-15 06:56:13 [DEBUG   ] summary = ERROR
2019-01-15 06:56:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173729  13 58498 24973978 A  ERRORERROR'
2019-01-15 06:56:14 [DEBUG   ] Got command RPT from MCS: ref #1173730
2019-01-15 06:56:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:56:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173730  77 58498 24974181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:56:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 06:56:14 [DEBUG   ] Got command RPT from MCS: ref #1173731
2019-01-15 06:56:14 [DEBUG   ] summary = ERROR
2019-01-15 06:56:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173731  13 58498 24974385 A  ERRORERROR'
2019-01-15 06:56:14 [DEBUG   ] Got command RPT from MCS: ref #1173733
2019-01-15 06:56:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 06:56:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173733  77 58498 24974577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 06:56:14 [DEBUG   ] Got command RPT from MCS: ref #1173734
2019-01-15 06:56:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 06:56:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173734  12 58498 24974781 A  ERRORB—™š'
2019-01-15 06:56:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 06:56:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:56:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:56:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:56:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:56:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:56:53 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-15 06:56:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 06:57:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 06:57:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-15 06:57:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:57:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:57:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:57:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:57:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:57:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:57:53 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-15 06:57:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 06:58:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 06:58:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:58:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:58:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:58:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:58:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:58:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:58:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:58:53 [DEBUG   ] Finished updating board flags in 1.573 seconds
2019-01-15 06:58:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 06:59:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 06:59:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 06:59:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 06:59:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:59:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:59:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:59:53 [WARNING ] (13, 1, 'bot')
2019-01-15 06:59:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 06:59:53 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-01-15 06:59:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:00:15 [DEBUG   ] Finished updating ant stats in 1.275 seconds
2019-01-15 07:00:35 [DEBUG   ] Finished updating ant stats in 1.128 seconds
2019-01-15 07:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:00:53 [WARNING ] (13, 1, 'bot')
2019-01-15 07:00:53 [WARNING ] (13, 1, 'bot')
2019-01-15 07:00:53 [WARNING ] (13, 1, 'bot')
2019-01-15 07:00:53 [WARNING ] (13, 1, 'bot')
2019-01-15 07:00:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:00:53 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-01-15 07:00:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:01:04 [DEBUG   ] Got command RPT from MCS: ref #1173747
2019-01-15 07:01:04 [DEBUG   ] summary = ERROR
2019-01-15 07:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173747  13 58498 25264933 A  ERRORERROR'
2019-01-15 07:01:04 [DEBUG   ] Got command RPT from MCS: ref #1173748
2019-01-15 07:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173748  77 58498 25264934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:01:14 [DEBUG   ] Got command RPT from MCS: ref #1173764
2019-01-15 07:01:14 [DEBUG   ] summary = ERROR
2019-01-15 07:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173764  13 58498 25274065 A  ERRORERROR'
2019-01-15 07:01:14 [DEBUG   ] Got command RPT from MCS: ref #1173765
2019-01-15 07:01:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173765  77 58498 25274257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:01:14 [DEBUG   ] Got command RPT from MCS: ref #1173766
2019-01-15 07:01:14 [DEBUG   ] summary = ERROR
2019-01-15 07:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173766  13 58498 25274465 A  ERRORERROR'
2019-01-15 07:01:14 [DEBUG   ] Got command RPT from MCS: ref #1173767
2019-01-15 07:01:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173767  77 58498 25274669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:01:14 [DEBUG   ] Got command RPT from MCS: ref #1173768
2019-01-15 07:01:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173768  12 58498 25274861 A  ERRORB•™š'
2019-01-15 07:01:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:01:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:01:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:01:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:01:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:01:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:01:54 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-15 07:01:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:02:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:02:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:02:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:02:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:02:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:02:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:02:54 [DEBUG   ] Finished updating board flags in 2.214 seconds
2019-01-15 07:02:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 07:03:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:03:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:03:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:03:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:03:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:03:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:03:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:03:55 [DEBUG   ] Finished updating board flags in 3.093 seconds
2019-01-15 07:04:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 07:04:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 07:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 07:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:04:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:04:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:04:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:04:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:04:54 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-01-15 07:04:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 07:05:15 [DEBUG   ] Finished updating ant stats in 0.702 seconds
2019-01-15 07:05:35 [DEBUG   ] Finished updating ant stats in 0.502 seconds
2019-01-15 07:05:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:05:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:05:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:05:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:05:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:05:54 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-15 07:05:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 07:06:04 [DEBUG   ] Got command RPT from MCS: ref #1173779
2019-01-15 07:06:04 [DEBUG   ] summary = ERROR
2019-01-15 07:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173779  13 58498 25564941 A  ERRORERROR'
2019-01-15 07:06:04 [DEBUG   ] Got command RPT from MCS: ref #1173780
2019-01-15 07:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173780  77 58498 25564942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:06:14 [DEBUG   ] Got command RPT from MCS: ref #1173796
2019-01-15 07:06:14 [DEBUG   ] summary = ERROR
2019-01-15 07:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173796  13 58498 25574133 A  ERRORERROR'
2019-01-15 07:06:14 [DEBUG   ] Got command RPT from MCS: ref #1173797
2019-01-15 07:06:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173797  77 58498 25574337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:06:14 [DEBUG   ] Got command RPT from MCS: ref #1173798
2019-01-15 07:06:14 [DEBUG   ] summary = ERROR
2019-01-15 07:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173798  13 58498 25574541 A  ERRORERROR'
2019-01-15 07:06:14 [DEBUG   ] Got command RPT from MCS: ref #1173800
2019-01-15 07:06:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173800  77 58498 25574745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:06:14 [DEBUG   ] Got command RPT from MCS: ref #1173801
2019-01-15 07:06:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173801  12 58498 25574938 A  ERRORB–™š'
2019-01-15 07:06:16 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 07:06:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 07:06:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 07:06:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:06:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:06:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:06:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:06:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:06:54 [DEBUG   ] Finished updating board flags in 1.771 seconds
2019-01-15 07:06:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:07:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 07:07:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 07:07:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:07:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:07:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:07:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:07:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:07:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:07:54 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-15 07:07:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:08:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:08:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:08:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:08:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:08:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:08:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:08:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:08:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:08:54 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-15 07:08:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:09:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:09:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:09:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 07:09:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:09:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:09:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:09:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:09:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:09:54 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-15 07:09:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:10:16 [DEBUG   ] Finished updating ant stats in 1.340 seconds
2019-01-15 07:10:37 [DEBUG   ] Finished updating ant stats in 1.864 seconds
2019-01-15 07:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 07:10:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:10:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:10:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:10:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:10:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:10:54 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-15 07:10:56 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-15 07:11:04 [DEBUG   ] Got command RPT from MCS: ref #1173810
2019-01-15 07:11:04 [DEBUG   ] summary = ERROR
2019-01-15 07:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173810  13 58498 25864941 A  ERRORERROR'
2019-01-15 07:11:04 [DEBUG   ] Got command RPT from MCS: ref #1173811
2019-01-15 07:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173811  77 58498 25864942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:11:14 [DEBUG   ] Got command RPT from MCS: ref #1173827
2019-01-15 07:11:14 [DEBUG   ] summary = ERROR
2019-01-15 07:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173827  13 58498 25874217 A  ERRORERROR'
2019-01-15 07:11:14 [DEBUG   ] Got command RPT from MCS: ref #1173828
2019-01-15 07:11:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173828  77 58498 25874421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:11:14 [DEBUG   ] Got command RPT from MCS: ref #1173829
2019-01-15 07:11:14 [DEBUG   ] summary = ERROR
2019-01-15 07:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173829  13 58498 25874625 A  ERRORERROR'
2019-01-15 07:11:14 [DEBUG   ] Got command RPT from MCS: ref #1173830
2019-01-15 07:11:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173830  77 58498 25874817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:11:15 [DEBUG   ] Got command RPT from MCS: ref #1173831
2019-01-15 07:11:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173831  12 58498 25875021 A  ERRORB—™š'
2019-01-15 07:11:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 07:11:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:11:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:11:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:11:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:11:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:11:54 [WARNING ] (13, 1, 'bot')
2019-01-15 07:11:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:11:54 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-15 07:11:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 07:12:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 07:12:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 07:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:12:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:12:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:12:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:12:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:12:55 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-15 07:12:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:13:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:13:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 07:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:13:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:13:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:13:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:13:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:13:55 [DEBUG   ] Finished updating board flags in 2.168 seconds
2019-01-15 07:13:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 07:14:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 07:14:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 07:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:14:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:14:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:14:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:14:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:14:55 [DEBUG   ] Finished updating board flags in 1.909 seconds
2019-01-15 07:14:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:15:17 [DEBUG   ] Finished updating ant stats in 1.538 seconds
2019-01-15 07:15:37 [DEBUG   ] Finished updating ant stats in 1.068 seconds
2019-01-15 07:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:15:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:15:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:15:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:15:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:15:55 [DEBUG   ] Finished updating board flags in 1.750 seconds
2019-01-15 07:15:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:16:04 [DEBUG   ] Got command RPT from MCS: ref #1173842
2019-01-15 07:16:04 [DEBUG   ] summary = ERROR
2019-01-15 07:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173842  13 58498 26164941 A  ERRORERROR'
2019-01-15 07:16:04 [DEBUG   ] Got command RPT from MCS: ref #1173843
2019-01-15 07:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173843  77 58498 26164942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:16:14 [DEBUG   ] Got command RPT from MCS: ref #1173859
2019-01-15 07:16:14 [DEBUG   ] summary = ERROR
2019-01-15 07:16:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173859  13 58498 26174301 A  ERRORERROR'
2019-01-15 07:16:14 [DEBUG   ] Got command RPT from MCS: ref #1173860
2019-01-15 07:16:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:16:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173860  77 58498 26174505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:16:14 [DEBUG   ] Got command RPT from MCS: ref #1173861
2019-01-15 07:16:14 [DEBUG   ] summary = ERROR
2019-01-15 07:16:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173861  13 58498 26174697 A  ERRORERROR'
2019-01-15 07:16:14 [DEBUG   ] Got command RPT from MCS: ref #1173863
2019-01-15 07:16:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:16:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173863  77 58498 26174901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:16:15 [DEBUG   ] Got command RPT from MCS: ref #1173864
2019-01-15 07:16:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173864  12 58498 26175105 A  ERRORB–™š'
2019-01-15 07:16:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 07:16:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 07:16:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 07:16:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:16:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:16:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:16:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:16:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:16:55 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-15 07:16:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 07:17:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 07:17:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 07:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:17:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:17:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:17:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:17:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:17:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:17:55 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-15 07:17:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:18:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 07:18:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 07:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:18:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:18:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:18:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:18:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:18:55 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-15 07:18:57 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-15 07:19:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 07:19:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 07:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:19:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:19:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:19:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:19:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:19:55 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-15 07:19:58 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 07:20:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 07:20:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:20:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:20:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:20:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:20:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:20:55 [WARNING ] (13, 1, 'bot')
2019-01-15 07:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:20:55 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-15 07:20:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:21:04 [DEBUG   ] Got command RPT from MCS: ref #1173877
2019-01-15 07:21:04 [DEBUG   ] summary = ERROR
2019-01-15 07:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173877  13 58498 26464941 A  ERRORERROR'
2019-01-15 07:21:04 [DEBUG   ] Got command RPT from MCS: ref #1173878
2019-01-15 07:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173878  77 58498 26464942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:21:14 [DEBUG   ] Got command RPT from MCS: ref #1173894
2019-01-15 07:21:14 [DEBUG   ] summary = ERROR
2019-01-15 07:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173894  13 58498 26474385 A  ERRORERROR'
2019-01-15 07:21:14 [DEBUG   ] Got command RPT from MCS: ref #1173895
2019-01-15 07:21:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173895  77 58498 26474577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:21:14 [DEBUG   ] Got command RPT from MCS: ref #1173896
2019-01-15 07:21:14 [DEBUG   ] summary = ERROR
2019-01-15 07:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173896  13 58498 26474781 A  ERRORERROR'
2019-01-15 07:21:14 [DEBUG   ] Got command RPT from MCS: ref #1173897
2019-01-15 07:21:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173897  77 58498 26474985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:21:15 [DEBUG   ] Got command RPT from MCS: ref #1173898
2019-01-15 07:21:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:21:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173898  12 58498 26475177 A  ERRORB•™š'
2019-01-15 07:21:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 07:21:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 07:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:21:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:21:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:21:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:21:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:21:56 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-01-15 07:21:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:22:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 07:22:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:22:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:22:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:22:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:22:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:22:56 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-01-15 07:22:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:23:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:23:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 07:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:23:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:23:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:23:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:23:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:23:56 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-15 07:23:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 07:24:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:24:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 07:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:24:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:24:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:24:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:24:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:24:56 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-15 07:24:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 07:25:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:25:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:25:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:25:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:25:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:25:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:25:56 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 07:25:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 07:26:04 [DEBUG   ] Got command RPT from MCS: ref #1173915
2019-01-15 07:26:04 [DEBUG   ] summary = ERROR
2019-01-15 07:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173915  13 58498 26764937 A  ERRORERROR'
2019-01-15 07:26:04 [DEBUG   ] Got command RPT from MCS: ref #1173916
2019-01-15 07:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173916  77 58498 26764938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:26:14 [DEBUG   ] Got command RPT from MCS: ref #1173932
2019-01-15 07:26:14 [DEBUG   ] summary = ERROR
2019-01-15 07:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173932  13 58498 26774457 A  ERRORERROR'
2019-01-15 07:26:14 [DEBUG   ] Got command RPT from MCS: ref #1173933
2019-01-15 07:26:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173933  77 58498 26774661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:26:14 [DEBUG   ] Got command RPT from MCS: ref #1173934
2019-01-15 07:26:14 [DEBUG   ] summary = ERROR
2019-01-15 07:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173934  13 58498 26774865 A  ERRORERROR'
2019-01-15 07:26:15 [DEBUG   ] Got command RPT from MCS: ref #1173936
2019-01-15 07:26:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:26:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173936  77 58498 26775057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:26:15 [DEBUG   ] Got command RPT from MCS: ref #1173937
2019-01-15 07:26:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:26:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173937  12 58498 26775261 A  ERRORB—™š'
2019-01-15 07:26:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 07:26:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 07:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 07:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:26:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:26:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:26:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:26:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:26:56 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-15 07:26:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 07:27:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:27:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:27:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 07:27:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:27:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:27:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:27:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:27:56 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-15 07:27:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:28:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:28:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 07:28:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 07:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:28:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:28:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:28:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:28:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:28:56 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-01-15 07:28:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:29:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:29:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:29:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:29:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:29:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:29:56 [WARNING ] (13, 1, 'bot')
2019-01-15 07:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:29:56 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-15 07:29:59 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-15 07:30:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 07:30:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:30:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:30:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:30:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:30:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:30:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:30:57 [DEBUG   ] Finished updating board flags in 2.035 seconds
2019-01-15 07:30:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 07:31:04 [DEBUG   ] Got command RPT from MCS: ref #1173950
2019-01-15 07:31:04 [DEBUG   ] summary = ERROR
2019-01-15 07:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173950  13 58498 27064945 A  ERRORERROR'
2019-01-15 07:31:04 [DEBUG   ] Got command RPT from MCS: ref #1173951
2019-01-15 07:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173951  77 58498 27064946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:31:14 [DEBUG   ] Got command RPT from MCS: ref #1173967
2019-01-15 07:31:14 [DEBUG   ] summary = ERROR
2019-01-15 07:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173967  13 58498 27074545 A  ERRORERROR'
2019-01-15 07:31:14 [DEBUG   ] Got command RPT from MCS: ref #1173968
2019-01-15 07:31:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173968  77 58498 27074737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:31:14 [DEBUG   ] Got command RPT from MCS: ref #1173969
2019-01-15 07:31:14 [DEBUG   ] summary = ERROR
2019-01-15 07:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173969  13 58498 27074941 A  ERRORERROR'
2019-01-15 07:31:15 [DEBUG   ] Got command RPT from MCS: ref #1173970
2019-01-15 07:31:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173970  77 58498 27075145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:31:15 [DEBUG   ] Got command RPT from MCS: ref #1173971
2019-01-15 07:31:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173971  12 58498 27075349 A  ERRORB—™š'
2019-01-15 07:31:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 07:31:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 07:31:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 07:31:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:31:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:31:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:31:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:31:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:31:57 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-01-15 07:32:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 07:32:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 07:32:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:32:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:32:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:32:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:32:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:32:57 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 07:33:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:33:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:33:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 07:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:33:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:33:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:33:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:33:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:33:57 [DEBUG   ] Finished updating board flags in 1.839 seconds
2019-01-15 07:34:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:34:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:34:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:34:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:34:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:34:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:34:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:34:57 [DEBUG   ] Finished updating board flags in 1.873 seconds
2019-01-15 07:35:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 07:35:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:35:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 07:35:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:35:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:35:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:35:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:35:57 [DEBUG   ] Finished updating board flags in 1.690 seconds
2019-01-15 07:36:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:36:04 [DEBUG   ] Got command RPT from MCS: ref #1173982
2019-01-15 07:36:04 [DEBUG   ] summary = ERROR
2019-01-15 07:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173982  13 58498 27364937 A  ERRORERROR'
2019-01-15 07:36:04 [DEBUG   ] Got command RPT from MCS: ref #1173983
2019-01-15 07:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173983  77 58498 27364938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:36:14 [DEBUG   ] Got command RPT from MCS: ref #1173999
2019-01-15 07:36:14 [DEBUG   ] summary = ERROR
2019-01-15 07:36:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1173999  13 58498 27374621 A  ERRORERROR'
2019-01-15 07:36:14 [DEBUG   ] Got command RPT from MCS: ref #1174000
2019-01-15 07:36:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:36:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174000  77 58498 27374825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:36:15 [DEBUG   ] Got command RPT from MCS: ref #1174001
2019-01-15 07:36:15 [DEBUG   ] summary = ERROR
2019-01-15 07:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174001  13 58498 27375029 A  ERRORERROR'
2019-01-15 07:36:15 [DEBUG   ] Got command RPT from MCS: ref #1174003
2019-01-15 07:36:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174003  77 58498 27375221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:36:15 [DEBUG   ] Got command RPT from MCS: ref #1174004
2019-01-15 07:36:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174004  12 58498 27375425 A  ERRORB–™š'
2019-01-15 07:36:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 07:36:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:36:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:36:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:36:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:36:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:36:57 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-15 07:37:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 07:37:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 07:37:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 07:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:37:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:37:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:37:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:37:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:37:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:37:57 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-15 07:38:00 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-15 07:38:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 07:38:40 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 07:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:38:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:38:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:38:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:38:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:38:57 [DEBUG   ] Finished updating board flags in 1.573 seconds
2019-01-15 07:39:01 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2019-01-15 07:39:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:39:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 07:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:39:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 07:39:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:39:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:39:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:39:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:39:57 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-15 07:40:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 07:40:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 07:40:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 07:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:40:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:40:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:40:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:40:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:40:57 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-15 07:41:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 07:41:04 [DEBUG   ] Got command RPT from MCS: ref #1174013
2019-01-15 07:41:04 [DEBUG   ] summary = ERROR
2019-01-15 07:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174013  13 58498 27664941 A  ERRORERROR'
2019-01-15 07:41:04 [DEBUG   ] Got command RPT from MCS: ref #1174014
2019-01-15 07:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174014  77 58498 27664942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:41:14 [DEBUG   ] Got command RPT from MCS: ref #1174030
2019-01-15 07:41:14 [DEBUG   ] summary = ERROR
2019-01-15 07:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174030  13 58498 27674697 A  ERRORERROR'
2019-01-15 07:41:14 [DEBUG   ] Got command RPT from MCS: ref #1174031
2019-01-15 07:41:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174031  77 58498 27674902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:41:15 [DEBUG   ] Got command RPT from MCS: ref #1174032
2019-01-15 07:41:15 [DEBUG   ] summary = ERROR
2019-01-15 07:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174032  13 58498 27675105 A  ERRORERROR'
2019-01-15 07:41:15 [DEBUG   ] Got command RPT from MCS: ref #1174033
2019-01-15 07:41:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174033  77 58498 27675309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:41:15 [DEBUG   ] Got command RPT from MCS: ref #1174034
2019-01-15 07:41:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174034  12 58498 27675501 A  ERRORB—™š'
2019-01-15 07:41:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 07:41:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:41:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:41:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:41:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:41:57 [WARNING ] (13, 1, 'bot')
2019-01-15 07:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:41:57 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 07:42:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 07:42:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 07:42:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 07:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:42:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:42:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:42:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:42:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:42:58 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-15 07:43:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 07:43:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 07:43:42 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 07:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:43:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:43:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:43:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:43:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:43:58 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-15 07:44:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 07:44:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:44:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 07:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:44:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:44:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:44:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:44:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:44:58 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-15 07:45:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 07:45:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 07:45:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 07:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:45:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:45:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:45:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:45:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:45:58 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-15 07:46:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 07:46:04 [DEBUG   ] Got command RPT from MCS: ref #1174045
2019-01-15 07:46:04 [DEBUG   ] summary = ERROR
2019-01-15 07:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174045  13 58498 27964941 A  ERRORERROR'
2019-01-15 07:46:04 [DEBUG   ] Got command RPT from MCS: ref #1174046
2019-01-15 07:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174046  77 58498 27964942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:46:14 [DEBUG   ] Got command RPT from MCS: ref #1174062
2019-01-15 07:46:14 [DEBUG   ] summary = ERROR
2019-01-15 07:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174062  13 58498 27974782 A  ERRORERROR'
2019-01-15 07:46:14 [DEBUG   ] Got command RPT from MCS: ref #1174063
2019-01-15 07:46:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174063  77 58498 27974985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:46:15 [DEBUG   ] Got command RPT from MCS: ref #1174064
2019-01-15 07:46:15 [DEBUG   ] summary = ERROR
2019-01-15 07:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174064  13 58498 27975177 A  ERRORERROR'
2019-01-15 07:46:15 [DEBUG   ] Got command RPT from MCS: ref #1174066
2019-01-15 07:46:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174066  77 58498 27975382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:46:15 [DEBUG   ] Got command RPT from MCS: ref #1174067
2019-01-15 07:46:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174067  12 58498 27975585 A  ERRORB–™š'
2019-01-15 07:46:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:46:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:46:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:46:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:46:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:46:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:46:58 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-15 07:47:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:47:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 07:47:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:47:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 07:47:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:47:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:47:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:47:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:47:58 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 07:48:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:48:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 07:48:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 07:48:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:48:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:48:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:48:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:48:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:48:58 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 07:49:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 07:49:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:49:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 07:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:49:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:49:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:49:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:49:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:49:58 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-15 07:50:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 07:50:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 07:50:43 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 07:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:50:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:50:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:50:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:50:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:50:58 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-15 07:51:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 07:51:04 [DEBUG   ] Got command RPT from MCS: ref #1174080
2019-01-15 07:51:04 [DEBUG   ] summary = ERROR
2019-01-15 07:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174080  13 58498 28264941 A  ERRORERROR'
2019-01-15 07:51:04 [DEBUG   ] Got command RPT from MCS: ref #1174081
2019-01-15 07:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174081  77 58498 28264942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:51:14 [DEBUG   ] Got command RPT from MCS: ref #1174097
2019-01-15 07:51:14 [DEBUG   ] summary = ERROR
2019-01-15 07:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174097  13 58498 28274865 A  ERRORERROR'
2019-01-15 07:51:15 [DEBUG   ] Got command RPT from MCS: ref #1174098
2019-01-15 07:51:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174098  77 58498 28275057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:51:15 [DEBUG   ] Got command RPT from MCS: ref #1174099
2019-01-15 07:51:15 [DEBUG   ] summary = ERROR
2019-01-15 07:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174099  13 58498 28275261 A  ERRORERROR'
2019-01-15 07:51:15 [DEBUG   ] Got command RPT from MCS: ref #1174100
2019-01-15 07:51:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174100  77 58498 28275465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:51:15 [DEBUG   ] Got command RPT from MCS: ref #1174101
2019-01-15 07:51:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174101  12 58498 28275674 A  ERRORB–™š'
2019-01-15 07:51:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:51:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:51:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:51:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:51:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:51:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:51:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:51:58 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-15 07:52:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:52:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 07:52:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:52:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:52:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:52:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:52:58 [WARNING ] (13, 1, 'bot')
2019-01-15 07:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:52:58 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-01-15 07:53:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:53:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 07:53:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 07:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:53:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:53:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:53:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:53:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:53:59 [DEBUG   ] Finished updating board flags in 2.057 seconds
2019-01-15 07:54:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 07:54:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 07:54:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 07:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:54:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:54:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:54:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:54:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:54:59 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-15 07:55:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 07:55:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 07:55:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 07:55:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:55:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:55:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:55:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:55:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:55:59 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-15 07:56:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 07:56:04 [DEBUG   ] Got command RPT from MCS: ref #1174108
2019-01-15 07:56:04 [DEBUG   ] summary = ERROR
2019-01-15 07:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174108  13 58498 28564945 A  ERRORERROR'
2019-01-15 07:56:04 [DEBUG   ] Got command RPT from MCS: ref #1174109
2019-01-15 07:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174109  77 58498 28564946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:56:14 [DEBUG   ] Got command RPT from MCS: ref #1174125
2019-01-15 07:56:14 [DEBUG   ] summary = ERROR
2019-01-15 07:56:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174125  13 58498 28574941 A  ERRORERROR'
2019-01-15 07:56:15 [DEBUG   ] Got command RPT from MCS: ref #1174126
2019-01-15 07:56:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:56:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174126  77 58498 28575145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:56:15 [DEBUG   ] Got command RPT from MCS: ref #1174127
2019-01-15 07:56:15 [DEBUG   ] summary = ERROR
2019-01-15 07:56:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174127  13 58498 28575349 A  ERRORERROR'
2019-01-15 07:56:15 [DEBUG   ] Got command RPT from MCS: ref #1174129
2019-01-15 07:56:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 07:56:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174129  77 58498 28575541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 07:56:15 [DEBUG   ] Got command RPT from MCS: ref #1174131
2019-01-15 07:56:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 07:56:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174131  12 58498 28575745 A  ERRORB•™š'
2019-01-15 07:56:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:56:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:56:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:56:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:56:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:56:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:56:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:56:59 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-15 07:57:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 07:57:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:57:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 07:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:57:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:57:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:57:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:57:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:57:59 [DEBUG   ] Finished updating board flags in 1.842 seconds
2019-01-15 07:58:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 07:58:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 07:58:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 07:58:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:58:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 07:58:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:58:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:58:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:58:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:58:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:58:59 [DEBUG   ] Finished updating board flags in 1.769 seconds
2019-01-15 07:59:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:59:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 07:59:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 07:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 07:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 07:59:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:59:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:59:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:59:59 [WARNING ] (13, 1, 'bot')
2019-01-15 07:59:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 07:59:59 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-15 08:00:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 08:00:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 08:00:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:00:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:00:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:00:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:00:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:00:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:00:59 [DEBUG   ] Finished updating board flags in 1.555 seconds
2019-01-15 08:01:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:01:04 [DEBUG   ] Got command RPT from MCS: ref #1174143
2019-01-15 08:01:04 [DEBUG   ] summary = ERROR
2019-01-15 08:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174143  13 58498 28864949 A  ERRORERROR'
2019-01-15 08:01:04 [DEBUG   ] Got command RPT from MCS: ref #1174144
2019-01-15 08:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174144  77 58498 28864950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:01:15 [DEBUG   ] Got command RPT from MCS: ref #1174160
2019-01-15 08:01:15 [DEBUG   ] summary = ERROR
2019-01-15 08:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174160  13 58498 28875029 A  ERRORERROR'
2019-01-15 08:01:15 [DEBUG   ] Got command RPT from MCS: ref #1174161
2019-01-15 08:01:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174161  77 58498 28875221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:01:15 [DEBUG   ] Got command RPT from MCS: ref #1174162
2019-01-15 08:01:15 [DEBUG   ] summary = ERROR
2019-01-15 08:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174162  13 58498 28875425 A  ERRORERROR'
2019-01-15 08:01:15 [DEBUG   ] Got command RPT from MCS: ref #1174163
2019-01-15 08:01:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174163  77 58498 28875629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:01:15 [DEBUG   ] Got command RPT from MCS: ref #1174164
2019-01-15 08:01:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174164  12 58498 28875821 A  ERRORB—™š'
2019-01-15 08:01:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 08:01:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 08:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:01:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:01:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:01:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:01:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:01:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:01:59 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-15 08:02:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 08:02:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 08:02:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 08:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:02:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:02:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:02:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:02:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:02:59 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-15 08:03:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 08:03:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 08:03:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 08:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:03:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:03:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:03:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:03:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:03:59 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-15 08:04:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 08:04:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:04:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 08:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:05:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:05:00 [DEBUG   ] Finished updating board flags in 2.205 seconds
2019-01-15 08:05:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 08:05:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 08:05:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 08:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:05:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:59 [WARNING ] (13, 1, 'bot')
2019-01-15 08:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:05:59 [DEBUG   ] Finished updating board flags in 1.317 seconds
2019-01-15 08:06:04 [DEBUG   ] Got command RPT from MCS: ref #1174175
2019-01-15 08:06:04 [DEBUG   ] summary = ERROR
2019-01-15 08:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174175  13 58498 29164949 A  ERRORERROR'
2019-01-15 08:06:04 [DEBUG   ] Got command RPT from MCS: ref #1174176
2019-01-15 08:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174176  77 58498 29164950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:06:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 08:06:15 [DEBUG   ] Got command RPT from MCS: ref #1174192
2019-01-15 08:06:15 [DEBUG   ] summary = ERROR
2019-01-15 08:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174192  13 58498 29175101 A  ERRORERROR'
2019-01-15 08:06:15 [DEBUG   ] Got command RPT from MCS: ref #1174193
2019-01-15 08:06:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174193  77 58498 29175305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:06:15 [DEBUG   ] Got command RPT from MCS: ref #1174194
2019-01-15 08:06:15 [DEBUG   ] summary = ERROR
2019-01-15 08:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174194  13 58498 29175509 A  ERRORERROR'
2019-01-15 08:06:15 [DEBUG   ] Got command RPT from MCS: ref #1174196
2019-01-15 08:06:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174196  77 58498 29175701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:06:15 [DEBUG   ] Got command RPT from MCS: ref #1174198
2019-01-15 08:06:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174198  12 58498 29175905 A  ERRORB—™š'
2019-01-15 08:06:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 08:06:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 08:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:07:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:07:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:07:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:07:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:07:00 [DEBUG   ] Finished updating board flags in 2.087 seconds
2019-01-15 08:07:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:07:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 08:07:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 08:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:08:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:08:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:08:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:08:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:08:00 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-15 08:08:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 08:08:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 08:08:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 08:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:09:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:09:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:09:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:09:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:09:00 [DEBUG   ] Finished updating board flags in 1.973 seconds
2019-01-15 08:09:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 08:09:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 08:09:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 08:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:10:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:10:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:10:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:10:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:10:00 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-15 08:10:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:10:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:10:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 08:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:11:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:11:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:11:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:11:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:11:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:11:00 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-15 08:11:04 [DEBUG   ] Got command RPT from MCS: ref #1174206
2019-01-15 08:11:04 [DEBUG   ] summary = ERROR
2019-01-15 08:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174206  13 58498 29464949 A  ERRORERROR'
2019-01-15 08:11:04 [DEBUG   ] Got command RPT from MCS: ref #1174207
2019-01-15 08:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174207  77 58498 29464950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:11:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 08:11:15 [DEBUG   ] Got command RPT from MCS: ref #1174223
2019-01-15 08:11:15 [DEBUG   ] summary = ERROR
2019-01-15 08:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174223  13 58498 29475177 A  ERRORERROR'
2019-01-15 08:11:15 [DEBUG   ] Got command RPT from MCS: ref #1174224
2019-01-15 08:11:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174224  77 58498 29475393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:11:15 [DEBUG   ] Got command RPT from MCS: ref #1174225
2019-01-15 08:11:15 [DEBUG   ] summary = ERROR
2019-01-15 08:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174225  13 58498 29475585 A  ERRORERROR'
2019-01-15 08:11:15 [DEBUG   ] Got command RPT from MCS: ref #1174226
2019-01-15 08:11:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174226  77 58498 29475789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:11:15 [DEBUG   ] Got command RPT from MCS: ref #1174227
2019-01-15 08:11:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174227  12 58498 29475981 A  ERRORB–™š'
2019-01-15 08:11:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 08:11:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 08:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:12:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:12:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:12:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:12:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:12:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:12:00 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-15 08:12:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 08:12:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 08:12:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:13:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:13:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:13:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:13:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:13:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:13:00 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-15 08:13:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:13:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 08:13:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:14:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:14:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:14:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:14:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:14:00 [DEBUG   ] Finished updating board flags in 1.483 seconds
2019-01-15 08:14:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:14:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:14:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 08:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:15:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:15:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:15:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:15:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:15:00 [DEBUG   ] Finished updating board flags in 1.481 seconds
2019-01-15 08:15:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 08:15:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 08:15:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 08:16:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:16:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:16:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:16:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:16:00 [WARNING ] (13, 1, 'bot')
2019-01-15 08:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:16:00 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-01-15 08:16:04 [DEBUG   ] Got command RPT from MCS: ref #1174238
2019-01-15 08:16:04 [DEBUG   ] summary = ERROR
2019-01-15 08:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174238  13 58498 29764957 A  ERRORERROR'
2019-01-15 08:16:04 [DEBUG   ] Got command RPT from MCS: ref #1174239
2019-01-15 08:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174239  77 58498 29764958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:16:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 08:16:15 [DEBUG   ] Got command RPT from MCS: ref #1174255
2019-01-15 08:16:15 [DEBUG   ] summary = ERROR
2019-01-15 08:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174255  13 58498 29775265 A  ERRORERROR'
2019-01-15 08:16:15 [DEBUG   ] Got command RPT from MCS: ref #1174256
2019-01-15 08:16:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174256  77 58498 29775457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:16:15 [DEBUG   ] Got command RPT from MCS: ref #1174257
2019-01-15 08:16:15 [DEBUG   ] summary = ERROR
2019-01-15 08:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174257  13 58498 29775661 A  ERRORERROR'
2019-01-15 08:16:15 [DEBUG   ] Got command RPT from MCS: ref #1174259
2019-01-15 08:16:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174259  77 58498 29775865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:16:16 [DEBUG   ] Got command RPT from MCS: ref #1174260
2019-01-15 08:16:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174260  12 58498 29776069 A  ERRORB•™š'
2019-01-15 08:16:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 08:16:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 08:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:17:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:17:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:17:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:17:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:17:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:17:01 [DEBUG   ] Finished updating board flags in 2.288 seconds
2019-01-15 08:17:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 08:17:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 08:17:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:18:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:18:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:18:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:18:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:18:01 [DEBUG   ] Finished updating board flags in 2.091 seconds
2019-01-15 08:18:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:18:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 08:18:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 08:19:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 08:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:19:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:19:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:19:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:19:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:19:01 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-15 08:19:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 08:19:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 08:19:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 08:20:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:20:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:20:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:20:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:20:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:20:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:20:01 [DEBUG   ] Finished updating board flags in 1.959 seconds
2019-01-15 08:20:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 08:20:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 08:20:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 08:21:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 08:21:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:21:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:21:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:21:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:21:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:21:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:21:01 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-15 08:21:04 [DEBUG   ] Got command RPT from MCS: ref #1174273
2019-01-15 08:21:04 [DEBUG   ] summary = ERROR
2019-01-15 08:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174273  13 58498 30064957 A  ERRORERROR'
2019-01-15 08:21:04 [DEBUG   ] Got command RPT from MCS: ref #1174274
2019-01-15 08:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174274  77 58498 30064958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:21:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 08:21:15 [DEBUG   ] Got command RPT from MCS: ref #1174290
2019-01-15 08:21:15 [DEBUG   ] summary = ERROR
2019-01-15 08:21:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174290  13 58498 30075345 A  ERRORERROR'
2019-01-15 08:21:15 [DEBUG   ] Got command RPT from MCS: ref #1174291
2019-01-15 08:21:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:21:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174291  77 58498 30075537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:21:15 [DEBUG   ] Got command RPT from MCS: ref #1174292
2019-01-15 08:21:15 [DEBUG   ] summary = ERROR
2019-01-15 08:21:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174292  13 58498 30075741 A  ERRORERROR'
2019-01-15 08:21:15 [DEBUG   ] Got command RPT from MCS: ref #1174293
2019-01-15 08:21:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:21:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174293  77 58498 30075945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:21:16 [DEBUG   ] Got command RPT from MCS: ref #1174294
2019-01-15 08:21:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174294  12 58498 30076149 A  ERRORB—™š'
2019-01-15 08:21:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 08:21:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 08:22:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:22:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:22:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:22:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:22:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:22:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:22:01 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 08:22:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 08:22:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 08:22:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:23:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:23:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:23:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:23:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:23:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:23:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:23:01 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 08:23:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:23:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:23:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 08:24:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:24:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:24:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:24:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:24:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:24:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:24:01 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-15 08:24:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:24:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:24:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:25:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:25:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:25:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:25:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:25:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:25:01 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 08:25:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 08:25:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 08:25:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 08:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:26:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:26:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:26:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:26:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:26:01 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 08:26:04 [DEBUG   ] Got command RPT from MCS: ref #1174301
2019-01-15 08:26:04 [DEBUG   ] summary = ERROR
2019-01-15 08:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174301  13 58498 30364953 A  ERRORERROR'
2019-01-15 08:26:04 [DEBUG   ] Got command RPT from MCS: ref #1174302
2019-01-15 08:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174302  77 58498 30364954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:26:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 08:26:15 [DEBUG   ] Got command RPT from MCS: ref #1174318
2019-01-15 08:26:15 [DEBUG   ] summary = ERROR
2019-01-15 08:26:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174318  13 58498 30375417 A  ERRORERROR'
2019-01-15 08:26:15 [DEBUG   ] Got command RPT from MCS: ref #1174319
2019-01-15 08:26:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:26:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174319  77 58498 30375621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:26:15 [DEBUG   ] Got command RPT from MCS: ref #1174320
2019-01-15 08:26:15 [DEBUG   ] summary = ERROR
2019-01-15 08:26:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174320  13 58498 30375825 A  ERRORERROR'
2019-01-15 08:26:16 [DEBUG   ] Got command RPT from MCS: ref #1174322
2019-01-15 08:26:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:26:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174322  77 58498 30376029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:26:16 [DEBUG   ] Got command RPT from MCS: ref #1174323
2019-01-15 08:26:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:26:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174323  12 58498 30376221 A  ERRORB—™š'
2019-01-15 08:26:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 08:26:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:27:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:27:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:27:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:27:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:27:01 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-15 08:27:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 08:27:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:27:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 08:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:28:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:28:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:28:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:28:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:28:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:28:01 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-15 08:28:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:28:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:28:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:29:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:29:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:29:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:29:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:29:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:29:01 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-01-15 08:29:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 08:29:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 08:29:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 08:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:30:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 08:30:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:30:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:30:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:30:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:30:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:30:01 [DEBUG   ] Finished updating board flags in 1.451 seconds
2019-01-15 08:30:08 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 08:30:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 08:30:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 08:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:31:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:31:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:31:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:31:01 [WARNING ] (13, 1, 'bot')
2019-01-15 08:31:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:31:01 [DEBUG   ] Finished updating board flags in 1.440 seconds
2019-01-15 08:31:04 [DEBUG   ] Got command RPT from MCS: ref #1174336
2019-01-15 08:31:04 [DEBUG   ] summary = ERROR
2019-01-15 08:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174336  13 58498 30664953 A  ERRORERROR'
2019-01-15 08:31:04 [DEBUG   ] Got command RPT from MCS: ref #1174337
2019-01-15 08:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174337  77 58498 30664954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:31:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 08:31:15 [DEBUG   ] Got command RPT from MCS: ref #1174353
2019-01-15 08:31:15 [DEBUG   ] summary = ERROR
2019-01-15 08:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174353  13 58498 30675501 A  ERRORERROR'
2019-01-15 08:31:15 [DEBUG   ] Got command RPT from MCS: ref #1174354
2019-01-15 08:31:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174354  77 58498 30675705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:31:15 [DEBUG   ] Got command RPT from MCS: ref #1174355
2019-01-15 08:31:15 [DEBUG   ] summary = ERROR
2019-01-15 08:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174355  13 58498 30675909 A  ERRORERROR'
2019-01-15 08:31:16 [DEBUG   ] Got command RPT from MCS: ref #1174356
2019-01-15 08:31:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:31:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174356  77 58498 30676101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:31:16 [DEBUG   ] Got command RPT from MCS: ref #1174357
2019-01-15 08:31:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:31:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174357  12 58498 30676305 A  ERRORB–™š'
2019-01-15 08:31:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 08:31:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 08:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 08:32:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:32:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 08:32:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:32:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:32:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:32:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:32:02 [DEBUG   ] Finished updating board flags in 2.240 seconds
2019-01-15 08:32:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:32:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 08:32:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 08:33:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:33:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:33:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:33:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:33:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:33:02 [DEBUG   ] Finished updating board flags in 2.258 seconds
2019-01-15 08:33:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 08:33:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 08:33:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 08:34:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:34:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:34:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:34:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:34:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:34:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:34:02 [DEBUG   ] Finished updating board flags in 2.099 seconds
2019-01-15 08:34:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 08:34:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 08:34:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:35:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:35:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:35:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:35:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:35:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:35:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:35:02 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-15 08:35:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:35:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 08:35:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 08:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:36:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:36:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:36:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:36:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:36:02 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-15 08:36:04 [DEBUG   ] Got command RPT from MCS: ref #1174368
2019-01-15 08:36:04 [DEBUG   ] summary = ERROR
2019-01-15 08:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174368  13 58498 30964953 A  ERRORERROR'
2019-01-15 08:36:04 [DEBUG   ] Got command RPT from MCS: ref #1174369
2019-01-15 08:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174369  77 58498 30964954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:36:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 08:36:15 [DEBUG   ] Got command RPT from MCS: ref #1174385
2019-01-15 08:36:15 [DEBUG   ] summary = ERROR
2019-01-15 08:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174385  13 58498 30975585 A  ERRORERROR'
2019-01-15 08:36:15 [DEBUG   ] Got command RPT from MCS: ref #1174386
2019-01-15 08:36:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174386  77 58498 30975789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:36:15 [DEBUG   ] Got command RPT from MCS: ref #1174387
2019-01-15 08:36:15 [DEBUG   ] summary = ERROR
2019-01-15 08:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174387  13 58498 30975981 A  ERRORERROR'
2019-01-15 08:36:16 [DEBUG   ] Got command RPT from MCS: ref #1174389
2019-01-15 08:36:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174389  77 58498 30976185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:36:16 [DEBUG   ] Got command RPT from MCS: ref #1174390
2019-01-15 08:36:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174390  12 58498 30976389 A  ERRORB˜™š'
2019-01-15 08:36:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 08:36:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 08:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:37:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:37:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:37:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:37:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:37:02 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-15 08:37:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 08:37:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 08:37:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:38:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:38:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:38:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:38:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:38:02 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-15 08:38:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:38:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:38:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 08:39:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:39:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:39:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:39:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:39:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:39:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:39:02 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-15 08:39:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 08:39:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 08:39:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 08:40:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:40:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:40:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:40:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:40:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:40:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:40:02 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 08:40:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 08:40:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:40:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:41:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:41:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:41:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:41:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:41:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:41:02 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 08:41:04 [DEBUG   ] Got command RPT from MCS: ref #1174399
2019-01-15 08:41:04 [DEBUG   ] summary = ERROR
2019-01-15 08:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174399  13 58498 31264961 A  ERRORERROR'
2019-01-15 08:41:04 [DEBUG   ] Got command RPT from MCS: ref #1174400
2019-01-15 08:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174400  77 58498 31264962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:41:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:41:15 [DEBUG   ] Got command RPT from MCS: ref #1174416
2019-01-15 08:41:15 [DEBUG   ] summary = ERROR
2019-01-15 08:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174416  13 58498 31275669 A  ERRORERROR'
2019-01-15 08:41:15 [DEBUG   ] Got command RPT from MCS: ref #1174417
2019-01-15 08:41:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174417  77 58498 31275861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:41:16 [DEBUG   ] Got command RPT from MCS: ref #1174418
2019-01-15 08:41:16 [DEBUG   ] summary = ERROR
2019-01-15 08:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174418  13 58498 31276069 A  ERRORERROR'
2019-01-15 08:41:16 [DEBUG   ] Got command RPT from MCS: ref #1174419
2019-01-15 08:41:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174419  77 58498 31276269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:41:16 [DEBUG   ] Got command RPT from MCS: ref #1174420
2019-01-15 08:41:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174420  12 58498 31276473 A  ERRORB—™š'
2019-01-15 08:41:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 08:41:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 08:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:42:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:42:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:42:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:42:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:42:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:42:02 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-15 08:42:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 08:42:30 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 08:42:50 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-15 08:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 08:43:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:43:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:43:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:43:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:43:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:43:02 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-15 08:43:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 08:43:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 08:43:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 08:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:44:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:44:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:44:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:44:02 [WARNING ] (13, 1, 'bot')
2019-01-15 08:44:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:44:02 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 08:44:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 08:44:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:44:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 08:45:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:45:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:45:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:45:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:45:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:45:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:45:03 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-15 08:45:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 08:45:32 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-15 08:45:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 08:46:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:46:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:46:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:46:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:46:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:46:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:46:03 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-01-15 08:46:04 [DEBUG   ] Got command RPT from MCS: ref #1174431
2019-01-15 08:46:04 [DEBUG   ] summary = ERROR
2019-01-15 08:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174431  13 58498 31564961 A  ERRORERROR'
2019-01-15 08:46:04 [DEBUG   ] Got command RPT from MCS: ref #1174432
2019-01-15 08:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174432  77 58498 31564962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:46:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 08:46:15 [DEBUG   ] Got command RPT from MCS: ref #1174448
2019-01-15 08:46:15 [DEBUG   ] summary = ERROR
2019-01-15 08:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174448  13 58498 31575749 A  ERRORERROR'
2019-01-15 08:46:15 [DEBUG   ] Got command RPT from MCS: ref #1174449
2019-01-15 08:46:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174449  77 58498 31575941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:46:16 [DEBUG   ] Got command RPT from MCS: ref #1174450
2019-01-15 08:46:16 [DEBUG   ] summary = ERROR
2019-01-15 08:46:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174450  13 58498 31576145 A  ERRORERROR'
2019-01-15 08:46:16 [DEBUG   ] Got command RPT from MCS: ref #1174452
2019-01-15 08:46:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:46:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174452  77 58498 31576349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:46:16 [DEBUG   ] Got command RPT from MCS: ref #1174454
2019-01-15 08:46:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:46:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174454  12 58498 31576553 A  ERRORB–™š'
2019-01-15 08:46:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 08:46:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:47:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:47:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:47:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:47:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:47:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:47:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:47:03 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-15 08:47:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:47:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 08:47:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 08:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:48:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:48:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:48:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:48:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:48:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:48:03 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-15 08:48:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 08:48:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 08:48:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 08:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 08:49:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:49:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:49:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:49:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:49:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:49:03 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-15 08:49:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 08:49:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 08:49:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 08:50:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 08:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:50:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:50:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:50:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:50:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:50:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:50:03 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-15 08:50:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 08:50:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 08:50:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 08:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:51:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:51:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:51:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:51:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:51:03 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-15 08:51:04 [DEBUG   ] Got command RPT from MCS: ref #1174466
2019-01-15 08:51:04 [DEBUG   ] summary = ERROR
2019-01-15 08:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174466  13 58498 31864957 A  ERRORERROR'
2019-01-15 08:51:04 [DEBUG   ] Got command RPT from MCS: ref #1174467
2019-01-15 08:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174467  77 58498 31864958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:51:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 08:51:15 [DEBUG   ] Got command RPT from MCS: ref #1174483
2019-01-15 08:51:15 [DEBUG   ] summary = ERROR
2019-01-15 08:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174483  13 58498 31875821 A  ERRORERROR'
2019-01-15 08:51:16 [DEBUG   ] Got command RPT from MCS: ref #1174484
2019-01-15 08:51:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174484  77 58498 31876025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:51:16 [DEBUG   ] Got command RPT from MCS: ref #1174485
2019-01-15 08:51:16 [DEBUG   ] summary = ERROR
2019-01-15 08:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174485  13 58498 31876229 A  ERRORERROR'
2019-01-15 08:51:16 [DEBUG   ] Got command RPT from MCS: ref #1174486
2019-01-15 08:51:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174486  77 58498 31876433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:51:16 [DEBUG   ] Got command RPT from MCS: ref #1174487
2019-01-15 08:51:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174487  12 58498 31876625 A  ERRORB˜™š'
2019-01-15 08:51:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 08:51:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 08:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:52:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:52:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:52:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:52:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:52:03 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-15 08:52:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 08:52:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:52:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 08:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 08:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:53:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:53:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:53:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:53:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:53:03 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-15 08:53:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 08:53:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 08:53:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 08:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:54:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:54:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:54:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:54:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:54:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:54:03 [DEBUG   ] Finished updating board flags in 1.565 seconds
2019-01-15 08:54:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 08:54:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:54:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 08:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:55:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:55:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:55:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:55:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:55:03 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-15 08:55:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 08:55:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 08:55:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 08:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:56:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:56:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:56:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:56:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:56:03 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 08:56:04 [DEBUG   ] Got command RPT from MCS: ref #1174494
2019-01-15 08:56:04 [DEBUG   ] summary = ERROR
2019-01-15 08:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174494  13 58498 32164961 A  ERRORERROR'
2019-01-15 08:56:04 [DEBUG   ] Got command RPT from MCS: ref #1174495
2019-01-15 08:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174495  77 58498 32164962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:56:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 08:56:15 [DEBUG   ] Got command RPT from MCS: ref #1174511
2019-01-15 08:56:15 [DEBUG   ] summary = ERROR
2019-01-15 08:56:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174511  13 58498 32175909 A  ERRORERROR'
2019-01-15 08:56:16 [DEBUG   ] Got command RPT from MCS: ref #1174512
2019-01-15 08:56:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174512  77 58498 32176101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:56:16 [DEBUG   ] Got command RPT from MCS: ref #1174513
2019-01-15 08:56:16 [DEBUG   ] summary = ERROR
2019-01-15 08:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174513  13 58498 32176305 A  ERRORERROR'
2019-01-15 08:56:16 [DEBUG   ] Got command RPT from MCS: ref #1174515
2019-01-15 08:56:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 08:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174515  77 58498 32176509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 08:56:16 [DEBUG   ] Got command RPT from MCS: ref #1174517
2019-01-15 08:56:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 08:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174517  12 58498 32176713 A  ERRORB—™š'
2019-01-15 08:56:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 08:56:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 08:57:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:57:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:57:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:57:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:57:03 [WARNING ] (13, 1, 'bot')
2019-01-15 08:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:57:03 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-01-15 08:57:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 08:57:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 08:57:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 08:58:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:58:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:58:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:58:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:58:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:58:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:58:04 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-01-15 08:58:14 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 08:58:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 08:58:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 08:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 08:59:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:59:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:59:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:59:04 [WARNING ] (13, 1, 'bot')
2019-01-15 08:59:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 08:59:04 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-15 08:59:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 08:59:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 08:59:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 09:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:00:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:00:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:00:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:00:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:00:04 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-15 09:00:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:00:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:00:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 09:01:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:01:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:01:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:01:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:01:04 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 09:01:04 [DEBUG   ] Got command RPT from MCS: ref #1174529
2019-01-15 09:01:04 [DEBUG   ] summary = ERROR
2019-01-15 09:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174529  13 58498 32464957 A  ERRORERROR'
2019-01-15 09:01:04 [DEBUG   ] Got command RPT from MCS: ref #1174530
2019-01-15 09:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174530  77 58498 32464958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:01:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 09:01:15 [DEBUG   ] Got command RPT from MCS: ref #1174546
2019-01-15 09:01:15 [DEBUG   ] summary = ERROR
2019-01-15 09:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174546  13 58498 32475985 A  ERRORERROR'
2019-01-15 09:01:16 [DEBUG   ] Got command RPT from MCS: ref #1174547
2019-01-15 09:01:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:01:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174547  77 58498 32476189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:01:16 [DEBUG   ] Got command RPT from MCS: ref #1174548
2019-01-15 09:01:16 [DEBUG   ] summary = ERROR
2019-01-15 09:01:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174548  13 58498 32476393 A  ERRORERROR'
2019-01-15 09:01:16 [DEBUG   ] Got command RPT from MCS: ref #1174549
2019-01-15 09:01:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:01:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174549  77 58498 32476585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:01:16 [DEBUG   ] Got command RPT from MCS: ref #1174550
2019-01-15 09:01:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:01:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174550  12 58498 32476789 A  ERRORB–™š'
2019-01-15 09:01:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 09:01:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 09:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 09:02:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:02:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:02:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:02:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:02:04 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-15 09:02:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 09:02:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 09:02:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:03:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:03:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:03:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:03:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:03:04 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-15 09:03:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 09:03:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:03:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 09:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:04:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:04:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:04:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:04:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:04:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:04:04 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-15 09:04:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 09:04:35 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 09:04:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 09:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:05:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:05:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:05:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:05:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:05:04 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-15 09:05:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 09:05:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 09:05:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 09:06:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 09:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:06:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:06:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:06:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:06:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:06:04 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-15 09:06:04 [DEBUG   ] Got command RPT from MCS: ref #1174561
2019-01-15 09:06:04 [DEBUG   ] summary = ERROR
2019-01-15 09:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174561  13 58498 32764961 A  ERRORERROR'
2019-01-15 09:06:04 [DEBUG   ] Got command RPT from MCS: ref #1174562
2019-01-15 09:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174562  77 58498 32764962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:06:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 09:06:16 [DEBUG   ] Got command RPT from MCS: ref #1174578
2019-01-15 09:06:16 [DEBUG   ] summary = ERROR
2019-01-15 09:06:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174578  13 58498 32776073 A  ERRORERROR'
2019-01-15 09:06:16 [DEBUG   ] Got command RPT from MCS: ref #1174579
2019-01-15 09:06:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:06:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174579  77 58498 32776265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:06:16 [DEBUG   ] Got command RPT from MCS: ref #1174580
2019-01-15 09:06:16 [DEBUG   ] summary = ERROR
2019-01-15 09:06:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174580  13 58498 32776469 A  ERRORERROR'
2019-01-15 09:06:16 [DEBUG   ] Got command RPT from MCS: ref #1174582
2019-01-15 09:06:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:06:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174582  77 58498 32776673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:06:16 [DEBUG   ] Got command RPT from MCS: ref #1174583
2019-01-15 09:06:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:06:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174583  12 58498 32776865 A  ERRORB—™š'
2019-01-15 09:06:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:06:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:07:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:07:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:07:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:07:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:07:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:07:04 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-15 09:07:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:07:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 09:07:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 09:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 09:08:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:08:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:08:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:08:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:08:04 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-15 09:08:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 09:08:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 09:08:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 09:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:09:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:09:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:09:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:09:04 [WARNING ] (13, 1, 'bot')
2019-01-15 09:09:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:09:04 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-01-15 09:09:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:09:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:09:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 09:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:10:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:10:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:10:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:10:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:10:05 [DEBUG   ] Finished updating board flags in 2.282 seconds
2019-01-15 09:10:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 09:10:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 09:10:56 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 09:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:11:04 [DEBUG   ] Got command RPT from MCS: ref #1174592
2019-01-15 09:11:04 [DEBUG   ] summary = ERROR
2019-01-15 09:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174592  13 58498 33064961 A  ERRORERROR'
2019-01-15 09:11:04 [DEBUG   ] Got command RPT from MCS: ref #1174593
2019-01-15 09:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174593  77 58498 33064962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 09:11:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:11:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:11:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:11:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:11:05 [DEBUG   ] Finished updating board flags in 2.117 seconds
2019-01-15 09:11:16 [DEBUG   ] Got command RPT from MCS: ref #1174609
2019-01-15 09:11:16 [DEBUG   ] summary = ERROR
2019-01-15 09:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174609  13 58498 33076141 A  ERRORERROR'
2019-01-15 09:11:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 09:11:16 [DEBUG   ] Got command RPT from MCS: ref #1174610
2019-01-15 09:11:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174610  77 58498 33076345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:11:16 [DEBUG   ] Got command RPT from MCS: ref #1174611
2019-01-15 09:11:16 [DEBUG   ] summary = ERROR
2019-01-15 09:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174611  13 58498 33076549 A  ERRORERROR'
2019-01-15 09:11:16 [DEBUG   ] Got command RPT from MCS: ref #1174612
2019-01-15 09:11:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174612  77 58498 33076753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:11:16 [DEBUG   ] Got command RPT from MCS: ref #1174613
2019-01-15 09:11:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174613  12 58498 33076945 A  ERRORB˜™š'
2019-01-15 09:11:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 09:11:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 09:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:12:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 09:12:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:12:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:12:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:12:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:12:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:12:05 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-15 09:12:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 09:12:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 09:12:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:13:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:13:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:13:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:13:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:13:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:13:05 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-15 09:13:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:13:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 09:13:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 09:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:14:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:14:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:14:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:14:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:14:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:14:05 [DEBUG   ] Finished updating board flags in 1.837 seconds
2019-01-15 09:14:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 09:14:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 09:14:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 09:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:15:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:15:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:15:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:15:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:15:05 [DEBUG   ] Finished updating board flags in 1.774 seconds
2019-01-15 09:15:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 09:15:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:15:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:16:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:16:04 [DEBUG   ] Got command RPT from MCS: ref #1174624
2019-01-15 09:16:04 [DEBUG   ] summary = ERROR
2019-01-15 09:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174624  13 58498 33364961 A  ERRORERROR'
2019-01-15 09:16:04 [DEBUG   ] Got command RPT from MCS: ref #1174625
2019-01-15 09:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174625  77 58498 33364962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:16:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 09:16:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:16:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:16:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:16:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:16:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:16:05 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-15 09:16:16 [DEBUG   ] Got command RPT from MCS: ref #1174641
2019-01-15 09:16:16 [DEBUG   ] summary = ERROR
2019-01-15 09:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174641  13 58498 33376221 A  ERRORERROR'
2019-01-15 09:16:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:16:16 [DEBUG   ] Got command RPT from MCS: ref #1174642
2019-01-15 09:16:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174642  77 58498 33376425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:16:16 [DEBUG   ] Got command RPT from MCS: ref #1174643
2019-01-15 09:16:16 [DEBUG   ] summary = ERROR
2019-01-15 09:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174643  13 58498 33376629 A  ERRORERROR'
2019-01-15 09:16:16 [DEBUG   ] Got command RPT from MCS: ref #1174645
2019-01-15 09:16:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174645  77 58498 33376833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:16:17 [DEBUG   ] Got command RPT from MCS: ref #1174647
2019-01-15 09:16:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174647  12 58498 33377025 A  ERRORB—™š'
2019-01-15 09:16:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:16:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 09:17:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:17:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:17:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:17:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:17:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:17:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:17:05 [DEBUG   ] Finished updating board flags in 1.640 seconds
2019-01-15 09:17:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 09:17:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 09:17:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 09:18:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:18:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:18:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:18:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:18:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:18:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:18:05 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-15 09:18:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 09:18:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 09:18:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 09:19:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:19:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:19:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:19:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:19:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:19:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:19:05 [DEBUG   ] Finished updating board flags in 1.543 seconds
2019-01-15 09:19:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 09:19:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:19:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:20:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:20:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:20:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:20:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:20:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:20:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:20:05 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-15 09:20:12 [DEBUG   ] Got command TBW from MCS: ref #1174656
2019-01-15 09:20:12 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-15 09:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1174656   8 58498 33612013 A  ERROR'
2019-01-15 09:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-15 09:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-15 09:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-15 09:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-15 09:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-15 09:20:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-15 09:20:15 [DEBUG   ] spawn_process: at 2019-01-15 09:20:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-15 09:20:15 [INFO    ] Finished spawning TBW
2019-01-15 09:21:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:21:04 [DEBUG   ] Got command RPT from MCS: ref #1174663
2019-01-15 09:21:04 [DEBUG   ] summary = ERROR
2019-01-15 09:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174663  13 58498 33664965 A  ERRORERROR'
2019-01-15 09:21:04 [DEBUG   ] Got command RPT from MCS: ref #1174664
2019-01-15 09:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174664  77 58498 33664966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:21:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:21:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:21:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:21:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:21:05 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-01-15 09:21:16 [DEBUG   ] Got command RPT from MCS: ref #1174681
2019-01-15 09:21:16 [DEBUG   ] summary = ERROR
2019-01-15 09:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174681  13 58498 33676305 A  ERRORERROR'
2019-01-15 09:21:16 [DEBUG   ] Got command RPT from MCS: ref #1174682
2019-01-15 09:21:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174682  77 58498 33676509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:21:16 [DEBUG   ] Got command RPT from MCS: ref #1174683
2019-01-15 09:21:16 [DEBUG   ] summary = ERROR
2019-01-15 09:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174683  13 58498 33676713 A  ERRORERROR'
2019-01-15 09:21:16 [DEBUG   ] Got command RPT from MCS: ref #1174684
2019-01-15 09:21:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174684  77 58498 33676905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:21:17 [DEBUG   ] Got command RPT from MCS: ref #1174685
2019-01-15 09:21:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174685  12 58498 33677109 A  ERRORB•™š'
2019-01-15 09:22:03 [INFO    ] __waitForTBW - TBW finished in 108.419 s
2019-01-15 09:22:04 [DEBUG   ] Finished updating ant stats in 0.332 seconds
2019-01-15 09:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 09:22:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:22:04 [INFO    ] Started antennas statistics background thread
2019-01-15 09:22:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547544126']
2019-01-15 09:22:04 [DEBUG   ] spawn_process: at 2019-01-15 09:22:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547544126']
2019-01-15 09:22:04 [INFO    ] Finished spawning TBN in 0.053 s
2019-01-15 09:22:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:22:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:22:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:22:05 [WARNING ] (13, 1, 'bot')
2019-01-15 09:22:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:22:05 [DEBUG   ] Finished updating board flags in 1.067 seconds
2019-01-15 09:22:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2019-01-15 09:22:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 09:23:05 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2019-01-15 09:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:23:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:23:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:23:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:23:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:23:06 [DEBUG   ] Finished updating board flags in 2.190 seconds
2019-01-15 09:23:25 [DEBUG   ] Finished updating ant stats in 1.146 seconds
2019-01-15 09:23:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:24:05 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2019-01-15 09:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:24:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:24:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:24:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:24:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:24:06 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-15 09:24:25 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-01-15 09:24:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 09:25:05 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2019-01-15 09:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:25:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:25:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:25:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:25:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:25:06 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-15 09:25:25 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-01-15 09:25:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 09:26:04 [DEBUG   ] Got command RPT from MCS: ref #1174695
2019-01-15 09:26:04 [DEBUG   ] summary = ERROR
2019-01-15 09:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174695  13 58498 33964965 A  ERRORERROR'
2019-01-15 09:26:04 [DEBUG   ] Got command RPT from MCS: ref #1174696
2019-01-15 09:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174696  77 58498 33964966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:26:05 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2019-01-15 09:26:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:26:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:26:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:26:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:26:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:26:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:26:06 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-15 09:26:16 [DEBUG   ] Got command RPT from MCS: ref #1174713
2019-01-15 09:26:16 [DEBUG   ] summary = ERROR
2019-01-15 09:26:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174713  13 58498 33976389 A  ERRORERROR'
2019-01-15 09:26:16 [DEBUG   ] Got command RPT from MCS: ref #1174714
2019-01-15 09:26:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:26:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174714  77 58498 33976593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:26:16 [DEBUG   ] Got command RPT from MCS: ref #1174715
2019-01-15 09:26:16 [DEBUG   ] summary = ERROR
2019-01-15 09:26:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174715  13 58498 33976797 A  ERRORERROR'
2019-01-15 09:26:16 [DEBUG   ] Got command RPT from MCS: ref #1174717
2019-01-15 09:26:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:26:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174717  77 58498 33976989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:26:17 [DEBUG   ] Got command RPT from MCS: ref #1174719
2019-01-15 09:26:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174719  12 58498 33977193 A  ERRORB˜™š'
2019-01-15 09:26:26 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2019-01-15 09:26:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 09:27:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:27:06 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2019-01-15 09:27:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:27:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:27:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:27:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:27:06 [DEBUG   ] Finished updating board flags in 1.652 seconds
2019-01-15 09:27:26 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2019-01-15 09:27:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 09:28:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:28:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 09:28:06 [DEBUG   ] Finished updating ant stats in 0.838 seconds
2019-01-15 09:28:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:28:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:28:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:28:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:28:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:28:06 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 09:28:26 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2019-01-15 09:28:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:29:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 09:29:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:29:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 09:29:06 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-01-15 09:29:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:29:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:29:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:29:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:29:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:29:06 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-15 09:29:26 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2019-01-15 09:29:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 09:30:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:30:06 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2019-01-15 09:30:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:30:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:30:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:30:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:30:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:30:06 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 09:30:27 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2019-01-15 09:30:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 09:31:04 [DEBUG   ] Got command RPT from MCS: ref #1174731
2019-01-15 09:31:04 [DEBUG   ] summary = ERROR
2019-01-15 09:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174731  13 58498 34264965 A  ERRORERROR'
2019-01-15 09:31:04 [DEBUG   ] Got command RPT from MCS: ref #1174732
2019-01-15 09:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174732  77 58498 34264966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:31:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:31:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:31:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:31:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:31:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:31:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:31:06 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-01-15 09:31:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 09:31:16 [DEBUG   ] Got command RPT from MCS: ref #1174748
2019-01-15 09:31:16 [DEBUG   ] summary = ERROR
2019-01-15 09:31:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174748  13 58498 34276473 A  ERRORERROR'
2019-01-15 09:31:16 [DEBUG   ] Got command RPT from MCS: ref #1174749
2019-01-15 09:31:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:31:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174749  77 58498 34276677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:31:16 [DEBUG   ] Got command RPT from MCS: ref #1174750
2019-01-15 09:31:16 [DEBUG   ] summary = ERROR
2019-01-15 09:31:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174750  13 58498 34276869 A  ERRORERROR'
2019-01-15 09:31:17 [DEBUG   ] Got command RPT from MCS: ref #1174751
2019-01-15 09:31:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174751  77 58498 34277073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:31:17 [DEBUG   ] Got command RPT from MCS: ref #1174752
2019-01-15 09:31:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174752  12 58498 34277277 A  ERRORB—™š'
2019-01-15 09:31:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 09:31:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 09:32:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:32:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:32:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:32:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:32:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:32:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:32:06 [DEBUG   ] Finished updating board flags in 1.447 seconds
2019-01-15 09:32:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:32:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:32:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 09:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:33:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:33:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:33:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:33:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:33:06 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-15 09:33:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 09:33:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:33:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 09:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:34:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:34:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:34:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:34:06 [WARNING ] (13, 1, 'bot')
2019-01-15 09:34:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:34:06 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-15 09:34:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 09:34:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 09:34:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 09:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:35:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:35:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:35:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:35:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:35:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:35:07 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-01-15 09:35:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 09:35:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:35:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 09:36:04 [DEBUG   ] Got command RPT from MCS: ref #1174761
2019-01-15 09:36:04 [DEBUG   ] summary = ERROR
2019-01-15 09:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174761  13 58498 34564973 A  ERRORERROR'
2019-01-15 09:36:04 [DEBUG   ] Got command RPT from MCS: ref #1174762
2019-01-15 09:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174762  77 58498 34564974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:36:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:36:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:36:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:36:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:36:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:36:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:36:07 [DEBUG   ] Finished updating board flags in 2.169 seconds
2019-01-15 09:36:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:36:16 [DEBUG   ] Got command RPT from MCS: ref #1174780
2019-01-15 09:36:16 [DEBUG   ] summary = ERROR
2019-01-15 09:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174780  13 58498 34576549 A  ERRORERROR'
2019-01-15 09:36:16 [DEBUG   ] Got command RPT from MCS: ref #1174781
2019-01-15 09:36:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174781  77 58498 34576753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:36:16 [DEBUG   ] Got command RPT from MCS: ref #1174782
2019-01-15 09:36:16 [DEBUG   ] summary = ERROR
2019-01-15 09:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174782  13 58498 34576957 A  ERRORERROR'
2019-01-15 09:36:17 [DEBUG   ] Got command RPT from MCS: ref #1174784
2019-01-15 09:36:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:36:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174784  77 58498 34577149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:36:17 [DEBUG   ] Got command RPT from MCS: ref #1174785
2019-01-15 09:36:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:36:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174785  12 58498 34577353 A  ERRORB–™š'
2019-01-15 09:36:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 09:36:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 09:37:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:37:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:37:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:37:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:37:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:37:07 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-15 09:37:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 09:37:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 09:37:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 09:38:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:38:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:38:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:38:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:38:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:38:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:38:07 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-01-15 09:38:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:38:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 09:38:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:39:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:39:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:39:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:39:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:39:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:39:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:39:07 [DEBUG   ] Finished updating board flags in 1.904 seconds
2019-01-15 09:39:08 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-15 09:39:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 09:39:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 09:40:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:40:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:40:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:40:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:40:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:40:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:40:07 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-15 09:40:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 09:40:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 09:40:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 09:41:04 [DEBUG   ] Got command RPT from MCS: ref #1174794
2019-01-15 09:41:04 [DEBUG   ] summary = ERROR
2019-01-15 09:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174794  13 58498 34864969 A  ERRORERROR'
2019-01-15 09:41:04 [DEBUG   ] Got command RPT from MCS: ref #1174795
2019-01-15 09:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174795  77 58498 34864970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:41:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:41:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:41:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:41:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:41:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:41:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:41:07 [DEBUG   ] Finished updating board flags in 1.771 seconds
2019-01-15 09:41:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 09:41:16 [DEBUG   ] Got command RPT from MCS: ref #1174811
2019-01-15 09:41:16 [DEBUG   ] summary = ERROR
2019-01-15 09:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174811  13 58498 34876629 A  ERRORERROR'
2019-01-15 09:41:16 [DEBUG   ] Got command RPT from MCS: ref #1174812
2019-01-15 09:41:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174812  77 58498 34876833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:41:17 [DEBUG   ] Got command RPT from MCS: ref #1174813
2019-01-15 09:41:17 [DEBUG   ] summary = ERROR
2019-01-15 09:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174813  13 58498 34877025 A  ERRORERROR'
2019-01-15 09:41:17 [DEBUG   ] Got command RPT from MCS: ref #1174814
2019-01-15 09:41:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174814  77 58498 34877229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:41:17 [DEBUG   ] Got command RPT from MCS: ref #1174815
2019-01-15 09:41:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174815  12 58498 34877433 A  ERRORB•™š'
2019-01-15 09:41:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 09:41:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 09:42:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:42:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:42:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:42:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:42:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:42:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:42:07 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 09:42:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:42:29 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 09:42:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 09:43:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:43:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:43:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:43:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:43:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:43:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:43:07 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-15 09:43:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 09:43:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 09:43:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 09:44:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:44:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:44:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:44:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:44:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:44:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:44:07 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-01-15 09:44:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 09:44:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:44:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:45:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 09:45:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:45:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:45:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:45:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:45:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:45:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:45:07 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-15 09:45:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:45:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 09:45:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 09:46:04 [DEBUG   ] Got command RPT from MCS: ref #1174824
2019-01-15 09:46:04 [DEBUG   ] summary = ERROR
2019-01-15 09:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174824  13 58498 35164965 A  ERRORERROR'
2019-01-15 09:46:04 [DEBUG   ] Got command RPT from MCS: ref #1174825
2019-01-15 09:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174825  77 58498 35164966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:46:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:46:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:46:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:46:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:46:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:46:07 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-15 09:46:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 09:46:16 [DEBUG   ] Got command RPT from MCS: ref #1174843
2019-01-15 09:46:16 [DEBUG   ] summary = ERROR
2019-01-15 09:46:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174843  13 58498 35176713 A  ERRORERROR'
2019-01-15 09:46:16 [DEBUG   ] Got command RPT from MCS: ref #1174844
2019-01-15 09:46:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:46:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174844  77 58498 35176905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:46:17 [DEBUG   ] Got command RPT from MCS: ref #1174845
2019-01-15 09:46:17 [DEBUG   ] summary = ERROR
2019-01-15 09:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174845  13 58498 35177109 A  ERRORERROR'
2019-01-15 09:46:17 [DEBUG   ] Got command RPT from MCS: ref #1174847
2019-01-15 09:46:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174847  77 58498 35177313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:46:17 [DEBUG   ] Got command RPT from MCS: ref #1174848
2019-01-15 09:46:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174848  12 58498 35177517 A  ERRORB—™š'
2019-01-15 09:46:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 09:46:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 09:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:47:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:47:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:47:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:47:07 [WARNING ] (13, 1, 'bot')
2019-01-15 09:47:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:47:07 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-15 09:47:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 09:47:30 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-01-15 09:47:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 09:48:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:48:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:48:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:48:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:48:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:48:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:48:08 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-01-15 09:48:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 09:48:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 09:48:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 09:49:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:49:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:49:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:49:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:49:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:49:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:49:08 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-15 09:49:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 09:49:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 09:49:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:50:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:50:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:50:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:50:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:50:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:50:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:50:08 [DEBUG   ] Finished updating board flags in 1.974 seconds
2019-01-15 09:50:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 09:50:30 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-01-15 09:50:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 09:51:04 [DEBUG   ] Got command RPT from MCS: ref #1174861
2019-01-15 09:51:04 [DEBUG   ] summary = ERROR
2019-01-15 09:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174861  13 58498 35464965 A  ERRORERROR'
2019-01-15 09:51:04 [DEBUG   ] Got command RPT from MCS: ref #1174862
2019-01-15 09:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174862  77 58498 35464966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:51:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:51:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:51:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:51:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:51:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:51:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:51:08 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 09:51:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 09:51:16 [DEBUG   ] Got command RPT from MCS: ref #1174878
2019-01-15 09:51:16 [DEBUG   ] summary = ERROR
2019-01-15 09:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174878  13 58498 35476785 A  ERRORERROR'
2019-01-15 09:51:16 [DEBUG   ] Got command RPT from MCS: ref #1174879
2019-01-15 09:51:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174879  77 58498 35476989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:51:17 [DEBUG   ] Got command RPT from MCS: ref #1174880
2019-01-15 09:51:17 [DEBUG   ] summary = ERROR
2019-01-15 09:51:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174880  13 58498 35477193 A  ERRORERROR'
2019-01-15 09:51:17 [DEBUG   ] Got command RPT from MCS: ref #1174881
2019-01-15 09:51:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:51:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174881  77 58498 35477397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:51:17 [DEBUG   ] Got command RPT from MCS: ref #1174882
2019-01-15 09:51:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:51:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174882  12 58498 35477589 A  ERRORB—™š'
2019-01-15 09:51:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:51:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:52:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:52:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:52:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:52:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:52:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:52:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:52:08 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-15 09:52:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 09:52:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 09:52:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 09:53:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:53:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:53:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:53:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:53:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:53:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:53:08 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-15 09:53:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 09:53:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 09:53:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 09:54:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:54:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:54:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:54:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:54:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:54:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:54:08 [DEBUG   ] Finished updating board flags in 1.643 seconds
2019-01-15 09:54:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:54:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:54:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:55:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:55:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:55:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:55:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:55:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:55:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:55:08 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-15 09:55:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 09:55:32 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 09:55:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 09:56:04 [DEBUG   ] Got command RPT from MCS: ref #1174887
2019-01-15 09:56:04 [DEBUG   ] summary = ERROR
2019-01-15 09:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174887  13 58498 35764969 A  ERRORERROR'
2019-01-15 09:56:04 [DEBUG   ] Got command RPT from MCS: ref #1174888
2019-01-15 09:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174888  77 58498 35764970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:56:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:56:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:56:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:56:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:56:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:56:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:56:08 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-15 09:56:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 09:56:16 [DEBUG   ] Got command RPT from MCS: ref #1174906
2019-01-15 09:56:16 [DEBUG   ] summary = ERROR
2019-01-15 09:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174906  13 58498 35776869 A  ERRORERROR'
2019-01-15 09:56:17 [DEBUG   ] Got command RPT from MCS: ref #1174907
2019-01-15 09:56:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174907  77 58498 35777073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:56:17 [DEBUG   ] Got command RPT from MCS: ref #1174908
2019-01-15 09:56:17 [DEBUG   ] summary = ERROR
2019-01-15 09:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174908  13 58498 35777277 A  ERRORERROR'
2019-01-15 09:56:17 [DEBUG   ] Got command RPT from MCS: ref #1174910
2019-01-15 09:56:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 09:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174910  77 58498 35777469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 09:56:17 [DEBUG   ] Got command RPT from MCS: ref #1174911
2019-01-15 09:56:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 09:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174911  12 58498 35777673 A  ERRORB–™š'
2019-01-15 09:56:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 09:56:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 09:57:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 09:57:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:57:08 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-01-15 09:57:12 [DEBUG   ] Finished updating ant stats in 0.988 seconds
2019-01-15 09:57:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 09:57:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 09:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 09:58:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:58:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:58:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:58:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:58:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:58:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:58:09 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-01-15 09:58:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:58:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:58:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:59:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 09:59:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:59:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:59:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:59:09 [WARNING ] (13, 1, 'bot')
2019-01-15 09:59:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 09:59:09 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-01-15 09:59:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 09:59:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 09:59:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 10:00:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:00:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:00:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:00:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:00:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:00:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:00:09 [DEBUG   ] Finished updating board flags in 1.965 seconds
2019-01-15 10:00:13 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 10:00:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 10:00:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 10:01:04 [DEBUG   ] Got command RPT from MCS: ref #1174924
2019-01-15 10:01:04 [DEBUG   ] summary = ERROR
2019-01-15 10:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174924  13 58498 36064969 A  ERRORERROR'
2019-01-15 10:01:04 [DEBUG   ] Got command RPT from MCS: ref #1174925
2019-01-15 10:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174925  77 58498 36064970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:01:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:01:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:01:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:01:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:01:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:01:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:01:09 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 10:01:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 10:01:16 [DEBUG   ] Got command RPT from MCS: ref #1174941
2019-01-15 10:01:16 [DEBUG   ] summary = ERROR
2019-01-15 10:01:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174941  13 58498 36076949 A  ERRORERROR'
2019-01-15 10:01:17 [DEBUG   ] Got command RPT from MCS: ref #1174942
2019-01-15 10:01:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:01:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174942  77 58498 36077153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:01:17 [DEBUG   ] Got command RPT from MCS: ref #1174943
2019-01-15 10:01:17 [DEBUG   ] summary = ERROR
2019-01-15 10:01:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174943  13 58498 36077357 A  ERRORERROR'
2019-01-15 10:01:17 [DEBUG   ] Got command RPT from MCS: ref #1174944
2019-01-15 10:01:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:01:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174944  77 58498 36077549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:01:17 [DEBUG   ] Got command RPT from MCS: ref #1174945
2019-01-15 10:01:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:01:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174945  12 58498 36077753 A  ERRORB˜™š'
2019-01-15 10:01:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 10:01:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:02:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:02:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:02:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:02:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:02:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:02:09 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 10:02:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:02:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 10:02:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:03:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:03:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:03:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:03:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:03:09 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-15 10:03:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:03:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 10:03:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 10:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:04:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:04:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:04:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:04:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:04:09 [DEBUG   ] Finished updating board flags in 1.653 seconds
2019-01-15 10:04:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 10:04:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 10:04:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:05:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:05:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:05:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:05:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:05:09 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 10:05:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 10:05:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 10:05:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 10:06:04 [DEBUG   ] Got command RPT from MCS: ref #1174954
2019-01-15 10:06:04 [DEBUG   ] summary = ERROR
2019-01-15 10:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174954  13 58498 36364969 A  ERRORERROR'
2019-01-15 10:06:04 [DEBUG   ] Got command RPT from MCS: ref #1174955
2019-01-15 10:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174955  77 58498 36364970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:06:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:06:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:06:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:06:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:06:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:06:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:06:09 [DEBUG   ] Finished updating board flags in 1.539 seconds
2019-01-15 10:06:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 10:06:17 [DEBUG   ] Got command RPT from MCS: ref #1174973
2019-01-15 10:06:17 [DEBUG   ] summary = ERROR
2019-01-15 10:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174973  13 58498 36377040 A  ERRORERROR'
2019-01-15 10:06:17 [DEBUG   ] Got command RPT from MCS: ref #1174974
2019-01-15 10:06:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174974  77 58498 36377229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:06:17 [DEBUG   ] Got command RPT from MCS: ref #1174975
2019-01-15 10:06:17 [DEBUG   ] summary = ERROR
2019-01-15 10:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174975  13 58498 36377433 A  ERRORERROR'
2019-01-15 10:06:17 [DEBUG   ] Got command RPT from MCS: ref #1174977
2019-01-15 10:06:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174977  77 58498 36377637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:06:17 [DEBUG   ] Got command RPT from MCS: ref #1174979
2019-01-15 10:06:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174979  12 58498 36377841 A  ERRORB—™š'
2019-01-15 10:06:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:06:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:07:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:07:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:07:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:07:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:07:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:07:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:07:09 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-15 10:07:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:07:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:07:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:08:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:08:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:08:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:08:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:08:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:08:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:08:09 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 10:08:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:08:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:08:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 10:09:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:09:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:09:09 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-15 10:09:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:09:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:09:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 10:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:10:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:10:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:10:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:10:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:10:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:10:09 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-15 10:10:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 10:10:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:10:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 10:11:04 [DEBUG   ] Got command RPT from MCS: ref #1174987
2019-01-15 10:11:04 [DEBUG   ] summary = ERROR
2019-01-15 10:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174987  13 58498 36664969 A  ERRORERROR'
2019-01-15 10:11:04 [DEBUG   ] Got command RPT from MCS: ref #1174988
2019-01-15 10:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1174988  77 58498 36664970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:11:09 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-15 10:11:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:11:17 [DEBUG   ] Got command RPT from MCS: ref #1175004
2019-01-15 10:11:17 [DEBUG   ] summary = ERROR
2019-01-15 10:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175004  13 58498 36677113 A  ERRORERROR'
2019-01-15 10:11:17 [DEBUG   ] Got command RPT from MCS: ref #1175005
2019-01-15 10:11:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175005  77 58498 36677317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:11:17 [DEBUG   ] Got command RPT from MCS: ref #1175006
2019-01-15 10:11:17 [DEBUG   ] summary = ERROR
2019-01-15 10:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175006  13 58498 36677509 A  ERRORERROR'
2019-01-15 10:11:17 [DEBUG   ] Got command RPT from MCS: ref #1175007
2019-01-15 10:11:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175007  77 58498 36677713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:11:17 [DEBUG   ] Got command RPT from MCS: ref #1175008
2019-01-15 10:11:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175008  12 58498 36677917 A  ERRORB–™š'
2019-01-15 10:11:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 10:11:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 10:12:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:12:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:12:09 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-15 10:12:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 10:12:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 10:12:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 10:13:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:13:09 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-15 10:13:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 10:13:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 10:13:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:14:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:14:09 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-15 10:14:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:14:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:14:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:15:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 10:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:15:09 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-15 10:15:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:15:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:15:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 10:16:04 [DEBUG   ] Got command RPT from MCS: ref #1175017
2019-01-15 10:16:04 [DEBUG   ] summary = ERROR
2019-01-15 10:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175017  13 58498 36964969 A  ERRORERROR'
2019-01-15 10:16:04 [DEBUG   ] Got command RPT from MCS: ref #1175018
2019-01-15 10:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175018  77 58498 36964970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:16:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:16:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:16:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:16:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:16:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:16:10 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-01-15 10:16:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 10:16:17 [DEBUG   ] Got command RPT from MCS: ref #1175036
2019-01-15 10:16:17 [DEBUG   ] summary = ERROR
2019-01-15 10:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175036  13 58498 36977193 A  ERRORERROR'
2019-01-15 10:16:17 [DEBUG   ] Got command RPT from MCS: ref #1175037
2019-01-15 10:16:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175037  77 58498 36977397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:16:17 [DEBUG   ] Got command RPT from MCS: ref #1175038
2019-01-15 10:16:17 [DEBUG   ] summary = ERROR
2019-01-15 10:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175038  13 58498 36977589 A  ERRORERROR'
2019-01-15 10:16:17 [DEBUG   ] Got command RPT from MCS: ref #1175040
2019-01-15 10:16:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175040  77 58498 36977793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:16:17 [DEBUG   ] Got command RPT from MCS: ref #1175041
2019-01-15 10:16:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175041  12 58498 36977997 A  ERRORB–™š'
2019-01-15 10:16:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:16:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:17:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:17:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:17:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:17:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:17:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:17:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:17:10 [DEBUG   ] Finished updating board flags in 1.885 seconds
2019-01-15 10:17:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 10:17:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 10:17:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:18:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:18:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:18:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:18:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:18:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:18:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:18:10 [DEBUG   ] Finished updating board flags in 1.830 seconds
2019-01-15 10:18:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:18:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:18:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 10:19:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:19:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:19:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:19:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:19:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:19:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:19:10 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-15 10:19:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 10:19:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 10:19:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 10:20:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:20:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:20:10 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 10:20:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:20:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:20:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:21:04 [DEBUG   ] Got command RPT from MCS: ref #1175054
2019-01-15 10:21:04 [DEBUG   ] summary = ERROR
2019-01-15 10:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175054  13 58498 37264977 A  ERRORERROR'
2019-01-15 10:21:04 [DEBUG   ] Got command RPT from MCS: ref #1175055
2019-01-15 10:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175055  77 58498 37264978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:21:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:21:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:21:10 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-15 10:21:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 10:21:17 [DEBUG   ] Got command RPT from MCS: ref #1175071
2019-01-15 10:21:17 [DEBUG   ] summary = ERROR
2019-01-15 10:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175071  13 58498 37277269 A  ERRORERROR'
2019-01-15 10:21:17 [DEBUG   ] Got command RPT from MCS: ref #1175072
2019-01-15 10:21:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175072  77 58498 37277473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:21:17 [DEBUG   ] Got command RPT from MCS: ref #1175073
2019-01-15 10:21:17 [DEBUG   ] summary = ERROR
2019-01-15 10:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175073  13 58498 37277677 A  ERRORERROR'
2019-01-15 10:21:17 [DEBUG   ] Got command RPT from MCS: ref #1175074
2019-01-15 10:21:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175074  77 58498 37277881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:21:18 [DEBUG   ] Got command RPT from MCS: ref #1175075
2019-01-15 10:21:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175075  12 58498 37278073 A  ERRORB–™š'
2019-01-15 10:21:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:21:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 10:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:22:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:22:10 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 10:22:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 10:22:36 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-15 10:22:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:23:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 10:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:23:10 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-15 10:23:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:23:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:23:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 10:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 10:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:24:10 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 10:24:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 10:24:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 10:24:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 10:25:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:25:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:25:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:25:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:25:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:25:11 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-15 10:25:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:25:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:25:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:26:04 [DEBUG   ] Got command RPT from MCS: ref #1175080
2019-01-15 10:26:04 [DEBUG   ] summary = ERROR
2019-01-15 10:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175080  13 58498 37564973 A  ERRORERROR'
2019-01-15 10:26:04 [DEBUG   ] Got command RPT from MCS: ref #1175081
2019-01-15 10:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175081  77 58498 37564974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:26:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:26:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:26:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:26:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:26:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:26:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:26:11 [DEBUG   ] Finished updating board flags in 2.179 seconds
2019-01-15 10:26:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:26:17 [DEBUG   ] Got command RPT from MCS: ref #1175099
2019-01-15 10:26:17 [DEBUG   ] summary = ERROR
2019-01-15 10:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175099  13 58498 37577349 A  ERRORERROR'
2019-01-15 10:26:17 [DEBUG   ] Got command RPT from MCS: ref #1175100
2019-01-15 10:26:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175100  77 58498 37577553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:26:17 [DEBUG   ] Got command RPT from MCS: ref #1175101
2019-01-15 10:26:17 [DEBUG   ] summary = ERROR
2019-01-15 10:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175101  13 58498 37577757 A  ERRORERROR'
2019-01-15 10:26:17 [DEBUG   ] Got command RPT from MCS: ref #1175103
2019-01-15 10:26:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175103  77 58498 37577961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:26:18 [DEBUG   ] Got command RPT from MCS: ref #1175104
2019-01-15 10:26:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:26:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175104  12 58498 37578153 A  ERRORB—™š'
2019-01-15 10:26:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:26:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:27:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:27:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:27:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:27:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:27:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:27:11 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-15 10:27:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:27:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 10:27:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:28:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:28:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:28:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:28:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:28:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:28:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:28:11 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-15 10:28:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:28:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 10:28:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 10:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:29:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:29:11 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-15 10:29:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 10:29:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:29:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:30:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:30:11 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-15 10:30:17 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-15 10:30:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 10:30:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 10:31:04 [DEBUG   ] Got command RPT from MCS: ref #1175117
2019-01-15 10:31:04 [DEBUG   ] summary = ERROR
2019-01-15 10:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175117  13 58498 37864977 A  ERRORERROR'
2019-01-15 10:31:04 [DEBUG   ] Got command RPT from MCS: ref #1175118
2019-01-15 10:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175118  77 58498 37864978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:31:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:31:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:31:11 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 10:31:17 [DEBUG   ] Got command RPT from MCS: ref #1175134
2019-01-15 10:31:17 [DEBUG   ] summary = ERROR
2019-01-15 10:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175134  13 58498 37877433 A  ERRORERROR'
2019-01-15 10:31:17 [DEBUG   ] Got command RPT from MCS: ref #1175135
2019-01-15 10:31:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175135  77 58498 37877637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:31:17 [DEBUG   ] Got command RPT from MCS: ref #1175136
2019-01-15 10:31:17 [DEBUG   ] summary = ERROR
2019-01-15 10:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175136  13 58498 37877841 A  ERRORERROR'
2019-01-15 10:31:18 [DEBUG   ] Got command RPT from MCS: ref #1175137
2019-01-15 10:31:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175137  77 58498 37878033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:31:18 [DEBUG   ] Got command RPT from MCS: ref #1175138
2019-01-15 10:31:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175138  12 58498 37878237 A  ERRORB—™š'
2019-01-15 10:31:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 10:31:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 10:31:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 10:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:32:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:32:11 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 10:32:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 10:32:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 10:32:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:33:11 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-15 10:33:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:33:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:33:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 10:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:34:11 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-01-15 10:34:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 10:34:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 10:34:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 10:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:35:11 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-15 10:35:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-15 10:35:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:35:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:36:04 [DEBUG   ] Got command RPT from MCS: ref #1175147
2019-01-15 10:36:04 [DEBUG   ] summary = ERROR
2019-01-15 10:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175147  13 58498 38164977 A  ERRORERROR'
2019-01-15 10:36:04 [DEBUG   ] Got command RPT from MCS: ref #1175148
2019-01-15 10:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175148  77 58498 38164978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 10:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:36:11 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-15 10:36:17 [DEBUG   ] Got command RPT from MCS: ref #1175166
2019-01-15 10:36:17 [DEBUG   ] summary = ERROR
2019-01-15 10:36:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175166  13 58498 38177521 A  ERRORERROR'
2019-01-15 10:36:17 [DEBUG   ] Got command RPT from MCS: ref #1175167
2019-01-15 10:36:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:36:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175167  77 58498 38177714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:36:17 [DEBUG   ] Got command RPT from MCS: ref #1175168
2019-01-15 10:36:17 [DEBUG   ] summary = ERROR
2019-01-15 10:36:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175168  13 58498 38177921 A  ERRORERROR'
2019-01-15 10:36:18 [DEBUG   ] Got command RPT from MCS: ref #1175170
2019-01-15 10:36:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175170  77 58498 38178117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:36:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:36:18 [DEBUG   ] Got command RPT from MCS: ref #1175171
2019-01-15 10:36:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175171  12 58498 38178325 A  ERRORB•™š'
2019-01-15 10:36:38 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-15 10:36:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 10:37:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:37:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:37:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:37:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:37:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:37:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:37:12 [DEBUG   ] Finished updating board flags in 2.201 seconds
2019-01-15 10:37:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 10:37:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 10:37:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 10:38:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:38:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:38:12 [DEBUG   ] Finished updating board flags in 2.166 seconds
2019-01-15 10:38:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 10:38:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 10:38:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 10:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:39:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:39:12 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-15 10:39:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:39:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:39:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 10:40:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 10:40:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:40:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 10:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:40:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:40:12 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 10:40:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 10:40:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:40:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:41:04 [DEBUG   ] Got command RPT from MCS: ref #1175180
2019-01-15 10:41:04 [DEBUG   ] summary = ERROR
2019-01-15 10:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175180  13 58498 38464977 A  ERRORERROR'
2019-01-15 10:41:04 [DEBUG   ] Got command RPT from MCS: ref #1175181
2019-01-15 10:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175181  77 58498 38464978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:41:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:41:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:41:12 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-15 10:41:17 [DEBUG   ] Got command RPT from MCS: ref #1175197
2019-01-15 10:41:17 [DEBUG   ] summary = ERROR
2019-01-15 10:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175197  13 58498 38477593 A  ERRORERROR'
2019-01-15 10:41:17 [DEBUG   ] Got command RPT from MCS: ref #1175198
2019-01-15 10:41:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175198  77 58498 38477797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:41:18 [DEBUG   ] Got command RPT from MCS: ref #1175199
2019-01-15 10:41:18 [DEBUG   ] summary = ERROR
2019-01-15 10:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175199  13 58498 38478001 A  ERRORERROR'
2019-01-15 10:41:18 [DEBUG   ] Got command RPT from MCS: ref #1175200
2019-01-15 10:41:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175200  77 58498 38478205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:41:18 [DEBUG   ] Got command RPT from MCS: ref #1175201
2019-01-15 10:41:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175201  12 58498 38478397 A  ERRORB—™š'
2019-01-15 10:41:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 10:41:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:41:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 10:42:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:42:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:42:12 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-15 10:42:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:42:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 10:43:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 10:43:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:43:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:43:12 [DEBUG   ] Finished updating board flags in 1.752 seconds
2019-01-15 10:43:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 10:43:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 10:44:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:44:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:44:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:44:12 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-15 10:44:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:44:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:45:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 10:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:45:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:45:12 [DEBUG   ] Finished updating board flags in 1.643 seconds
2019-01-15 10:45:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:45:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:46:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:46:04 [DEBUG   ] Got command RPT from MCS: ref #1175210
2019-01-15 10:46:04 [DEBUG   ] summary = ERROR
2019-01-15 10:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175210  13 58498 38764981 A  ERRORERROR'
2019-01-15 10:46:04 [DEBUG   ] Got command RPT from MCS: ref #1175211
2019-01-15 10:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175211  77 58498 38764982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:46:12 [DEBUG   ] Finished updating board flags in 1.543 seconds
2019-01-15 10:46:17 [DEBUG   ] Got command RPT from MCS: ref #1175229
2019-01-15 10:46:17 [DEBUG   ] summary = ERROR
2019-01-15 10:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175229  13 58498 38777685 A  ERRORERROR'
2019-01-15 10:46:17 [DEBUG   ] Got command RPT from MCS: ref #1175230
2019-01-15 10:46:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175230  77 58498 38777877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:46:18 [DEBUG   ] Got command RPT from MCS: ref #1175231
2019-01-15 10:46:18 [DEBUG   ] summary = ERROR
2019-01-15 10:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175231  13 58498 38778081 A  ERRORERROR'
2019-01-15 10:46:18 [DEBUG   ] Got command RPT from MCS: ref #1175233
2019-01-15 10:46:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175233  77 58498 38778285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:46:18 [DEBUG   ] Got command RPT from MCS: ref #1175234
2019-01-15 10:46:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175234  12 58498 38778477 A  ERRORB—™š'
2019-01-15 10:46:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:46:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:47:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:47:12 [DEBUG   ] Finished updating board flags in 1.500 seconds
2019-01-15 10:47:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:47:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:48:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:48:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 10:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:48:12 [DEBUG   ] Finished updating board flags in 1.542 seconds
2019-01-15 10:48:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 10:48:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 10:49:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 10:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:49:13 [DEBUG   ] Finished updating board flags in 2.233 seconds
2019-01-15 10:49:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:49:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:50:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 10:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:50:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:50:13 [DEBUG   ] Finished updating board flags in 2.142 seconds
2019-01-15 10:50:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 10:50:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 10:51:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-15 10:51:04 [DEBUG   ] Got command RPT from MCS: ref #1175247
2019-01-15 10:51:04 [DEBUG   ] summary = ERROR
2019-01-15 10:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175247  13 58498 39064985 A  ERRORERROR'
2019-01-15 10:51:04 [DEBUG   ] Got command RPT from MCS: ref #1175248
2019-01-15 10:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175248  77 58498 39064986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:51:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:51:13 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-15 10:51:17 [DEBUG   ] Got command RPT from MCS: ref #1175264
2019-01-15 10:51:17 [DEBUG   ] summary = ERROR
2019-01-15 10:51:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175264  13 58498 39077761 A  ERRORERROR'
2019-01-15 10:51:17 [DEBUG   ] Got command RPT from MCS: ref #1175265
2019-01-15 10:51:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:51:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175265  77 58498 39077965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:51:18 [DEBUG   ] Got command RPT from MCS: ref #1175266
2019-01-15 10:51:18 [DEBUG   ] summary = ERROR
2019-01-15 10:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175266  13 58498 39078169 A  ERRORERROR'
2019-01-15 10:51:18 [DEBUG   ] Got command RPT from MCS: ref #1175267
2019-01-15 10:51:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175267  77 58498 39078361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:51:18 [DEBUG   ] Got command RPT from MCS: ref #1175268
2019-01-15 10:51:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175268  12 58498 39078565 A  ERRORB–™š'
2019-01-15 10:51:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 10:51:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 10:52:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 10:52:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:52:13 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-01-15 10:52:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 10:52:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 10:53:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 10:53:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:53:13 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-15 10:53:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 10:53:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 10:54:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 10:54:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:54:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:54:13 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-15 10:54:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 10:54:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 10:55:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 10:55:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:55:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:55:13 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-15 10:55:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:55:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 10:56:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 10:56:04 [DEBUG   ] Got command RPT from MCS: ref #1175273
2019-01-15 10:56:04 [DEBUG   ] summary = ERROR
2019-01-15 10:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175273  13 58498 39364981 A  ERRORERROR'
2019-01-15 10:56:04 [DEBUG   ] Got command RPT from MCS: ref #1175274
2019-01-15 10:56:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175274  77 58498 39364982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:56:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:56:13 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 10:56:17 [DEBUG   ] Got command RPT from MCS: ref #1175292
2019-01-15 10:56:17 [DEBUG   ] summary = ERROR
2019-01-15 10:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175292  13 58498 39377849 A  ERRORERROR'
2019-01-15 10:56:18 [DEBUG   ] Got command RPT from MCS: ref #1175293
2019-01-15 10:56:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175293  77 58498 39378041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:56:18 [DEBUG   ] Got command RPT from MCS: ref #1175294
2019-01-15 10:56:18 [DEBUG   ] summary = ERROR
2019-01-15 10:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175294  13 58498 39378245 A  ERRORERROR'
2019-01-15 10:56:18 [DEBUG   ] Got command RPT from MCS: ref #1175296
2019-01-15 10:56:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 10:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175296  77 58498 39378449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 10:56:18 [DEBUG   ] Got command RPT from MCS: ref #1175298
2019-01-15 10:56:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 10:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175298  12 58498 39378641 A  ERRORB–™š'
2019-01-15 10:56:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 10:56:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 10:57:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 10:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:57:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:57:13 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-01-15 10:57:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 10:57:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 10:58:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 10:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:58:13 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-15 10:58:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 10:58:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 10:59:02 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-15 10:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 10:59:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:59:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:59:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:59:13 [WARNING ] (13, 1, 'bot')
2019-01-15 10:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 10:59:13 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-15 10:59:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 10:59:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 11:00:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 11:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 11:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:00:13 [WARNING ] (13, 1, 'bot')
2019-01-15 11:00:13 [WARNING ] (13, 1, 'bot')
2019-01-15 11:00:13 [WARNING ] (13, 1, 'bot')
2019-01-15 11:00:13 [WARNING ] (13, 1, 'bot')
2019-01-15 11:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:00:13 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-15 11:00:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:00:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:01:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 11:01:04 [DEBUG   ] Got command RPT from MCS: ref #1175310
2019-01-15 11:01:04 [DEBUG   ] summary = ERROR
2019-01-15 11:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175310  13 58498 39664985 A  ERRORERROR'
2019-01-15 11:01:04 [DEBUG   ] Got command RPT from MCS: ref #1175311
2019-01-15 11:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175311  77 58498 39664986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:01:14 [DEBUG   ] Finished updating board flags in 2.059 seconds
2019-01-15 11:01:17 [DEBUG   ] Got command RPT from MCS: ref #1175327
2019-01-15 11:01:17 [DEBUG   ] summary = ERROR
2019-01-15 11:01:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175327  13 58498 39677929 A  ERRORERROR'
2019-01-15 11:01:18 [DEBUG   ] Got command RPT from MCS: ref #1175328
2019-01-15 11:01:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175328  77 58498 39678121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:01:18 [DEBUG   ] Got command RPT from MCS: ref #1175329
2019-01-15 11:01:18 [DEBUG   ] summary = ERROR
2019-01-15 11:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175329  13 58498 39678325 A  ERRORERROR'
2019-01-15 11:01:18 [DEBUG   ] Got command RPT from MCS: ref #1175330
2019-01-15 11:01:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175330  77 58498 39678529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:01:18 [DEBUG   ] Got command RPT from MCS: ref #1175331
2019-01-15 11:01:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175331  12 58498 39678733 A  ERRORB˜™š'
2019-01-15 11:01:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:01:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:02:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 11:02:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:02:14 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-15 11:02:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 11:02:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 11:03:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:03:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:03:14 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-15 11:03:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 11:03:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 11:04:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:04:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:04:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:04:14 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-15 11:04:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:04:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:05:03 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2019-01-15 11:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:05:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:05:14 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-01-15 11:05:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-15 11:05:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 11:06:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 11:06:04 [DEBUG   ] Got command RPT from MCS: ref #1175340
2019-01-15 11:06:04 [DEBUG   ] summary = ERROR
2019-01-15 11:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175340  13 58498 39964981 A  ERRORERROR'
2019-01-15 11:06:04 [DEBUG   ] Got command RPT from MCS: ref #1175341
2019-01-15 11:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175341  77 58498 39964982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:06:14 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 11:06:18 [DEBUG   ] Got command RPT from MCS: ref #1175359
2019-01-15 11:06:18 [DEBUG   ] summary = ERROR
2019-01-15 11:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175359  13 58498 39978001 A  ERRORERROR'
2019-01-15 11:06:18 [DEBUG   ] Got command RPT from MCS: ref #1175360
2019-01-15 11:06:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175360  77 58498 39978205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:06:18 [DEBUG   ] Got command RPT from MCS: ref #1175361
2019-01-15 11:06:18 [DEBUG   ] summary = ERROR
2019-01-15 11:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175361  13 58498 39978409 A  ERRORERROR'
2019-01-15 11:06:18 [DEBUG   ] Got command RPT from MCS: ref #1175363
2019-01-15 11:06:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175363  77 58498 39978613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:06:18 [DEBUG   ] Got command RPT from MCS: ref #1175364
2019-01-15 11:06:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175364  12 58498 39978805 A  ERRORB—™š'
2019-01-15 11:06:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:06:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:07:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 11:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:07:14 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-15 11:07:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 11:07:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:08:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 11:08:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:08:14 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-15 11:08:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:08:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:09:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:09:15 [DEBUG   ] Finished updating board flags in 2.089 seconds
2019-01-15 11:09:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:09:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:10:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 11:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:10:15 [DEBUG   ] Finished updating board flags in 2.032 seconds
2019-01-15 11:10:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 11:10:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:11:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 11:11:04 [DEBUG   ] Got command RPT from MCS: ref #1175373
2019-01-15 11:11:04 [DEBUG   ] summary = ERROR
2019-01-15 11:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175373  13 58498 40264985 A  ERRORERROR'
2019-01-15 11:11:04 [DEBUG   ] Got command RPT from MCS: ref #1175374
2019-01-15 11:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175374  77 58498 40264986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:11:15 [DEBUG   ] Finished updating board flags in 1.926 seconds
2019-01-15 11:11:18 [DEBUG   ] Got command RPT from MCS: ref #1175390
2019-01-15 11:11:18 [DEBUG   ] summary = ERROR
2019-01-15 11:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175390  13 58498 40278081 A  ERRORERROR'
2019-01-15 11:11:18 [DEBUG   ] Got command RPT from MCS: ref #1175391
2019-01-15 11:11:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175391  77 58498 40278285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:11:18 [DEBUG   ] Got command RPT from MCS: ref #1175392
2019-01-15 11:11:18 [DEBUG   ] summary = ERROR
2019-01-15 11:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175392  13 58498 40278489 A  ERRORERROR'
2019-01-15 11:11:18 [DEBUG   ] Got command RPT from MCS: ref #1175393
2019-01-15 11:11:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175393  77 58498 40278693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:11:18 [DEBUG   ] Got command RPT from MCS: ref #1175394
2019-01-15 11:11:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175394  12 58498 40278885 A  ERRORB–™š'
2019-01-15 11:11:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 11:11:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 11:12:05 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 11:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:12:15 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-15 11:12:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 11:12:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:13:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 11:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:13:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:13:15 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-15 11:13:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:13:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 11:14:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 11:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:14:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:14:15 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 11:14:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 11:14:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:15:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 11:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:15:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:15:15 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-15 11:15:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:15:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:16:04 [DEBUG   ] Got command RPT from MCS: ref #1175403
2019-01-15 11:16:04 [DEBUG   ] summary = ERROR
2019-01-15 11:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175403  13 58498 40564981 A  ERRORERROR'
2019-01-15 11:16:04 [DEBUG   ] Got command RPT from MCS: ref #1175404
2019-01-15 11:16:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175404  77 58498 40564982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:16:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 11:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:16:15 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-15 11:16:18 [DEBUG   ] Got command RPT from MCS: ref #1175422
2019-01-15 11:16:18 [DEBUG   ] summary = ERROR
2019-01-15 11:16:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175422  13 58498 40578165 A  ERRORERROR'
2019-01-15 11:16:18 [DEBUG   ] Got command RPT from MCS: ref #1175423
2019-01-15 11:16:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:16:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175423  77 58498 40578369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:16:18 [DEBUG   ] Got command RPT from MCS: ref #1175424
2019-01-15 11:16:18 [DEBUG   ] summary = ERROR
2019-01-15 11:16:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175424  13 58498 40578573 A  ERRORERROR'
2019-01-15 11:16:18 [DEBUG   ] Got command RPT from MCS: ref #1175426
2019-01-15 11:16:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:16:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175426  77 58498 40578765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:16:18 [DEBUG   ] Got command RPT from MCS: ref #1175428
2019-01-15 11:16:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:16:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175428  12 58498 40578969 A  ERRORB—™š'
2019-01-15 11:16:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 11:16:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:17:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:17:15 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-15 11:17:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:17:45 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-15 11:18:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 11:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 11:18:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 11:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:18:15 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-15 11:18:26 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 11:18:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 11:19:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:19:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 11:19:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:19:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:19:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:19:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:19:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:19:16 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-01-15 11:19:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:19:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:20:06 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-15 11:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:20:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 11:20:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:20:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:20:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:20:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:20:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:20:16 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-15 11:20:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:20:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 11:21:04 [DEBUG   ] Got command RPT from MCS: ref #1175440
2019-01-15 11:21:04 [DEBUG   ] summary = ERROR
2019-01-15 11:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175440  13 58498 40864989 A  ERRORERROR'
2019-01-15 11:21:04 [DEBUG   ] Got command RPT from MCS: ref #1175441
2019-01-15 11:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175441  77 58498 40864990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:21:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:21:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:21:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:21:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:21:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:21:16 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-15 11:21:18 [DEBUG   ] Got command RPT from MCS: ref #1175457
2019-01-15 11:21:18 [DEBUG   ] summary = ERROR
2019-01-15 11:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175457  13 58498 40878245 A  ERRORERROR'
2019-01-15 11:21:18 [DEBUG   ] Got command RPT from MCS: ref #1175458
2019-01-15 11:21:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175458  77 58498 40878449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:21:18 [DEBUG   ] Got command RPT from MCS: ref #1175459
2019-01-15 11:21:18 [DEBUG   ] summary = ERROR
2019-01-15 11:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175459  13 58498 40878653 A  ERRORERROR'
2019-01-15 11:21:18 [DEBUG   ] Got command RPT from MCS: ref #1175460
2019-01-15 11:21:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175460  77 58498 40878845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:21:19 [DEBUG   ] Got command RPT from MCS: ref #1175461
2019-01-15 11:21:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175461  12 58498 40879049 A  ERRORB—™š'
2019-01-15 11:21:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 11:21:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:22:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 11:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:22:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 11:22:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:22:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:22:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:22:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:22:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:22:16 [DEBUG   ] Finished updating board flags in 2.037 seconds
2019-01-15 11:22:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:22:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:23:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:23:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 11:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:23:16 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-01-15 11:23:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 11:23:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:24:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 11:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:24:16 [DEBUG   ] Finished updating board flags in 1.949 seconds
2019-01-15 11:24:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:24:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 11:25:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 11:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:25:16 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-15 11:25:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 11:25:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:26:04 [DEBUG   ] Got command RPT from MCS: ref #1175466
2019-01-15 11:26:04 [DEBUG   ] summary = ERROR
2019-01-15 11:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175466  13 58498 41164989 A  ERRORERROR'
2019-01-15 11:26:04 [DEBUG   ] Got command RPT from MCS: ref #1175467
2019-01-15 11:26:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175467  77 58498 41164990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:26:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 11:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:26:16 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-15 11:26:18 [DEBUG   ] Got command RPT from MCS: ref #1175485
2019-01-15 11:26:18 [DEBUG   ] summary = ERROR
2019-01-15 11:26:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175485  13 58498 41178325 A  ERRORERROR'
2019-01-15 11:26:18 [DEBUG   ] Got command RPT from MCS: ref #1175486
2019-01-15 11:26:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:26:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175486  77 58498 41178529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:26:18 [DEBUG   ] Got command RPT from MCS: ref #1175487
2019-01-15 11:26:18 [DEBUG   ] summary = ERROR
2019-01-15 11:26:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175487  13 58498 41178733 A  ERRORERROR'
2019-01-15 11:26:18 [DEBUG   ] Got command RPT from MCS: ref #1175489
2019-01-15 11:26:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:26:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175489  77 58498 41178925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:26:19 [DEBUG   ] Got command RPT from MCS: ref #1175491
2019-01-15 11:26:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175491  12 58498 41179129 A  ERRORB—™š'
2019-01-15 11:26:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 11:26:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:27:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:27:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:27:16 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-15 11:27:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 11:27:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:28:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 11:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-15 11:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:28:16 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 11:28:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 11:28:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 11:29:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 11:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 11:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:29:16 [DEBUG   ] Finished updating board flags in 1.525 seconds
2019-01-15 11:29:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 11:29:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:30:07 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-15 11:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 11:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:30:16 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-15 11:30:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:30:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 11:31:04 [DEBUG   ] Got command RPT from MCS: ref #1175503
2019-01-15 11:31:04 [DEBUG   ] summary = ERROR
2019-01-15 11:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175503  13 58498 41464993 A  ERRORERROR'
2019-01-15 11:31:04 [DEBUG   ] Got command RPT from MCS: ref #1175504
2019-01-15 11:31:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175504  77 58498 41464994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:31:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:31:16 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-15 11:31:18 [DEBUG   ] Got command RPT from MCS: ref #1175520
2019-01-15 11:31:18 [DEBUG   ] summary = ERROR
2019-01-15 11:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175520  13 58498 41478413 A  ERRORERROR'
2019-01-15 11:31:18 [DEBUG   ] Got command RPT from MCS: ref #1175521
2019-01-15 11:31:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175521  77 58498 41478605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:31:18 [DEBUG   ] Got command RPT from MCS: ref #1175522
2019-01-15 11:31:18 [DEBUG   ] summary = ERROR
2019-01-15 11:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175522  13 58498 41478809 A  ERRORERROR'
2019-01-15 11:31:19 [DEBUG   ] Got command RPT from MCS: ref #1175523
2019-01-15 11:31:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175523  77 58498 41479013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:31:19 [DEBUG   ] Got command RPT from MCS: ref #1175524
2019-01-15 11:31:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175524  12 58498 41479217 A  ERRORB˜™š'
2019-01-15 11:31:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 11:31:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 11:32:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:32:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 11:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 11:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:32:16 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 11:32:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 11:32:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 11:33:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 11:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:33:16 [DEBUG   ] Finished updating board flags in 1.519 seconds
2019-01-15 11:33:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 11:33:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 11:34:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 11:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 11:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:34:16 [DEBUG   ] Finished updating board flags in 1.542 seconds
2019-01-15 11:34:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 11:34:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:35:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:35:17 [DEBUG   ] Finished updating board flags in 2.174 seconds
2019-01-15 11:35:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 11:35:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 11:36:04 [DEBUG   ] Got command RPT from MCS: ref #1175533
2019-01-15 11:36:04 [DEBUG   ] summary = ERROR
2019-01-15 11:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175533  13 58498 41764997 A  ERRORERROR'
2019-01-15 11:36:04 [DEBUG   ] Got command RPT from MCS: ref #1175534
2019-01-15 11:36:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175534  77 58498 41764998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:36:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 11:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:36:17 [DEBUG   ] Finished updating board flags in 2.017 seconds
2019-01-15 11:36:18 [DEBUG   ] Got command RPT from MCS: ref #1175552
2019-01-15 11:36:18 [DEBUG   ] summary = ERROR
2019-01-15 11:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175552  13 58498 41778493 A  ERRORERROR'
2019-01-15 11:36:18 [DEBUG   ] Got command RPT from MCS: ref #1175553
2019-01-15 11:36:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175553  77 58498 41778685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:36:18 [DEBUG   ] Got command RPT from MCS: ref #1175554
2019-01-15 11:36:18 [DEBUG   ] summary = ERROR
2019-01-15 11:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175554  13 58498 41778889 A  ERRORERROR'
2019-01-15 11:36:19 [DEBUG   ] Got command RPT from MCS: ref #1175556
2019-01-15 11:36:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:36:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175556  77 58498 41779093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:36:19 [DEBUG   ] Got command RPT from MCS: ref #1175557
2019-01-15 11:36:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:36:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175557  12 58498 41779297 A  ERRORB—™š'
2019-01-15 11:36:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:36:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:37:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:37:17 [DEBUG   ] Finished updating board flags in 1.920 seconds
2019-01-15 11:37:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:37:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:38:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:38:17 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-15 11:38:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 11:38:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:39:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:39:17 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-15 11:39:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 11:39:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:40:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:40:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:40:17 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-15 11:40:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:40:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 11:41:04 [DEBUG   ] Got command RPT from MCS: ref #1175566
2019-01-15 11:41:04 [DEBUG   ] summary = ERROR
2019-01-15 11:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175566  13 58498 42064989 A  ERRORERROR'
2019-01-15 11:41:04 [DEBUG   ] Got command RPT from MCS: ref #1175567
2019-01-15 11:41:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175567  77 58498 42064990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:41:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:41:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:41:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:41:17 [DEBUG   ] Finished updating board flags in 1.852 seconds
2019-01-15 11:41:18 [DEBUG   ] Got command RPT from MCS: ref #1175583
2019-01-15 11:41:18 [DEBUG   ] summary = ERROR
2019-01-15 11:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175583  13 58498 42078573 A  ERRORERROR'
2019-01-15 11:41:18 [DEBUG   ] Got command RPT from MCS: ref #1175584
2019-01-15 11:41:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175584  77 58498 42078765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:41:18 [DEBUG   ] Got command RPT from MCS: ref #1175585
2019-01-15 11:41:18 [DEBUG   ] summary = ERROR
2019-01-15 11:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175585  13 58498 42078969 A  ERRORERROR'
2019-01-15 11:41:19 [DEBUG   ] Got command RPT from MCS: ref #1175586
2019-01-15 11:41:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:41:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175586  77 58498 42079173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:41:19 [DEBUG   ] Got command RPT from MCS: ref #1175587
2019-01-15 11:41:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:41:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175587  12 58498 42079377 A  ERRORB—™š'
2019-01-15 11:41:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:41:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:42:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 11:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:42:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:42:17 [DEBUG   ] Finished updating board flags in 1.700 seconds
2019-01-15 11:42:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:42:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:43:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:43:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:43:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:43:17 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-15 11:43:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:43:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:44:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:44:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 11:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:44:17 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-15 11:44:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:44:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:45:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:45:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:45:17 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-15 11:45:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 11:45:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 11:46:04 [DEBUG   ] Got command RPT from MCS: ref #1175596
2019-01-15 11:46:04 [DEBUG   ] summary = ERROR
2019-01-15 11:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175596  13 58498 42364993 A  ERRORERROR'
2019-01-15 11:46:04 [DEBUG   ] Got command RPT from MCS: ref #1175597
2019-01-15 11:46:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175597  77 58498 42364994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:46:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:46:17 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-15 11:46:18 [DEBUG   ] Got command RPT from MCS: ref #1175615
2019-01-15 11:46:18 [DEBUG   ] summary = ERROR
2019-01-15 11:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175615  13 58498 42378649 A  ERRORERROR'
2019-01-15 11:46:18 [DEBUG   ] Got command RPT from MCS: ref #1175616
2019-01-15 11:46:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175616  77 58498 42378853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:46:19 [DEBUG   ] Got command RPT from MCS: ref #1175617
2019-01-15 11:46:19 [DEBUG   ] summary = ERROR
2019-01-15 11:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175617  13 58498 42379045 A  ERRORERROR'
2019-01-15 11:46:19 [DEBUG   ] Got command RPT from MCS: ref #1175619
2019-01-15 11:46:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175619  77 58498 42379249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:46:19 [DEBUG   ] Got command RPT from MCS: ref #1175620
2019-01-15 11:46:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175620  12 58498 42379453 A  ERRORB—™š'
2019-01-15 11:46:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:46:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 11:47:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:47:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:47:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:47:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:47:17 [WARNING ] (13, 1, 'bot')
2019-01-15 11:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:47:17 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-15 11:47:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 11:47:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:48:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:48:18 [DEBUG   ] Finished updating board flags in 2.268 seconds
2019-01-15 11:48:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 11:48:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:49:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 11:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 11:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:49:18 [DEBUG   ] Finished updating board flags in 2.086 seconds
2019-01-15 11:49:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:49:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:50:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 11:50:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:50:18 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-15 11:50:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 11:50:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 11:51:04 [DEBUG   ] Got command RPT from MCS: ref #1175633
2019-01-15 11:51:04 [DEBUG   ] summary = ERROR
2019-01-15 11:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175633  13 58498 42664993 A  ERRORERROR'
2019-01-15 11:51:04 [DEBUG   ] Got command RPT from MCS: ref #1175634
2019-01-15 11:51:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175634  77 58498 42664994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:51:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:51:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:51:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:51:18 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-15 11:51:18 [DEBUG   ] Got command RPT from MCS: ref #1175650
2019-01-15 11:51:18 [DEBUG   ] summary = ERROR
2019-01-15 11:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175650  13 58498 42678729 A  ERRORERROR'
2019-01-15 11:51:18 [DEBUG   ] Got command RPT from MCS: ref #1175651
2019-01-15 11:51:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175651  77 58498 42678933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:51:19 [DEBUG   ] Got command RPT from MCS: ref #1175652
2019-01-15 11:51:19 [DEBUG   ] summary = ERROR
2019-01-15 11:51:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175652  13 58498 42679137 A  ERRORERROR'
2019-01-15 11:51:19 [DEBUG   ] Got command RPT from MCS: ref #1175653
2019-01-15 11:51:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:51:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175653  77 58498 42679329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:51:19 [DEBUG   ] Got command RPT from MCS: ref #1175654
2019-01-15 11:51:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:51:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175654  12 58498 42679533 A  ERRORB–™š'
2019-01-15 11:51:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 11:51:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 11:52:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 11:52:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:52:18 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-15 11:52:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:52:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:53:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:53:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:53:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:53:18 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 11:53:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 11:53:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:54:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:54:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 11:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:54:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:54:18 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-15 11:54:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 11:54:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 11:55:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:55:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 11:55:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 11:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:55:18 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-01-15 11:55:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 11:55:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 11:56:05 [DEBUG   ] Got command RPT from MCS: ref #1175659
2019-01-15 11:56:05 [DEBUG   ] summary = ERROR
2019-01-15 11:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175659  13 58498 42965001 A  ERRORERROR'
2019-01-15 11:56:05 [DEBUG   ] Got command RPT from MCS: ref #1175660
2019-01-15 11:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175660  77 58498 42965002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:56:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 11:56:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:56:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:56:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:56:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:56:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:56:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:56:18 [DEBUG   ] Finished updating board flags in 1.569 seconds
2019-01-15 11:56:18 [DEBUG   ] Got command RPT from MCS: ref #1175678
2019-01-15 11:56:18 [DEBUG   ] summary = ERROR
2019-01-15 11:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175678  13 58498 42978817 A  ERRORERROR'
2019-01-15 11:56:19 [DEBUG   ] Got command RPT from MCS: ref #1175679
2019-01-15 11:56:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175679  77 58498 42979009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:56:19 [DEBUG   ] Got command RPT from MCS: ref #1175680
2019-01-15 11:56:19 [DEBUG   ] summary = ERROR
2019-01-15 11:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175680  13 58498 42979213 A  ERRORERROR'
2019-01-15 11:56:19 [DEBUG   ] Got command RPT from MCS: ref #1175682
2019-01-15 11:56:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 11:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175682  77 58498 42979417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 11:56:19 [DEBUG   ] Got command RPT from MCS: ref #1175684
2019-01-15 11:56:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 11:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175684  12 58498 42979609 A  ERRORB–™š'
2019-01-15 11:56:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 11:56:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 11:57:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 11:57:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:57:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:57:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:57:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:57:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:57:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:57:18 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 11:57:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 11:57:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 11:58:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 11:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:58:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:58:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:58:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:58:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:58:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:58:18 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 11:58:30 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-15 11:58:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 11:59:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 11:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 11:59:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 11:59:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:59:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:59:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:59:18 [WARNING ] (13, 1, 'bot')
2019-01-15 11:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 11:59:18 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-15 11:59:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 11:59:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 12:00:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:00:19 [DEBUG   ] Finished updating board flags in 2.073 seconds
2019-01-15 12:00:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:00:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:01:04 [DEBUG   ] Got command RPT from MCS: ref #1175696
2019-01-15 12:01:04 [DEBUG   ] summary = ERROR
2019-01-15 12:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175696  13 58498 43264997 A  ERRORERROR'
2019-01-15 12:01:04 [DEBUG   ] Got command RPT from MCS: ref #1175697
2019-01-15 12:01:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175697  77 58498 43264998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:01:10 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-15 12:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:01:18 [DEBUG   ] Got command RPT from MCS: ref #1175713
2019-01-15 12:01:18 [DEBUG   ] summary = ERROR
2019-01-15 12:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175713  13 58498 43278893 A  ERRORERROR'
2019-01-15 12:01:19 [DEBUG   ] Got command RPT from MCS: ref #1175714
2019-01-15 12:01:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175714  77 58498 43279097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:01:19 [DEBUG   ] Got command RPT from MCS: ref #1175715
2019-01-15 12:01:19 [DEBUG   ] summary = ERROR
2019-01-15 12:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175715  13 58498 43279289 A  ERRORERROR'
2019-01-15 12:01:19 [DEBUG   ] Got command RPT from MCS: ref #1175716
2019-01-15 12:01:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175716  77 58498 43279493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:01:19 [DEBUG   ] Finished updating board flags in 1.966 seconds
2019-01-15 12:01:19 [DEBUG   ] Got command RPT from MCS: ref #1175717
2019-01-15 12:01:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175717  12 58498 43279697 A  ERRORB—™š'
2019-01-15 12:01:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 12:01:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 12:02:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:02:19 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-15 12:02:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 12:02:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 12:03:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 12:03:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:03:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:03:19 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-15 12:03:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 12:03:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 12:04:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:04:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:04:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:04:19 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-15 12:04:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 12:04:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 12:05:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:05:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:05:19 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-15 12:05:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:05:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:06:04 [DEBUG   ] Got command RPT from MCS: ref #1175726
2019-01-15 12:06:04 [DEBUG   ] summary = ERROR
2019-01-15 12:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175726  13 58498 43564993 A  ERRORERROR'
2019-01-15 12:06:04 [DEBUG   ] Got command RPT from MCS: ref #1175727
2019-01-15 12:06:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175727  77 58498 43564994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:06:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:06:18 [DEBUG   ] Got command RPT from MCS: ref #1175745
2019-01-15 12:06:18 [DEBUG   ] summary = ERROR
2019-01-15 12:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175745  13 58498 43578978 A  ERRORERROR'
2019-01-15 12:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:06:19 [DEBUG   ] Got command RPT from MCS: ref #1175746
2019-01-15 12:06:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175746  77 58498 43579173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:06:19 [DEBUG   ] Got command RPT from MCS: ref #1175747
2019-01-15 12:06:19 [DEBUG   ] summary = ERROR
2019-01-15 12:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175747  13 58498 43579377 A  ERRORERROR'
2019-01-15 12:06:19 [DEBUG   ] Got command RPT from MCS: ref #1175749
2019-01-15 12:06:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175749  77 58498 43579581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:06:19 [DEBUG   ] Got command RPT from MCS: ref #1175750
2019-01-15 12:06:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175750  12 58498 43579773 A  ERRORB–™š'
2019-01-15 12:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 12:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:06:19 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-15 12:06:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:06:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:07:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:07:20 [DEBUG   ] Finished updating board flags in 2.090 seconds
2019-01-15 12:07:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 12:07:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 12:08:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 12:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:08:20 [DEBUG   ] Finished updating board flags in 1.954 seconds
2019-01-15 12:08:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 12:08:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:09:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:09:20 [DEBUG   ] Finished updating board flags in 1.838 seconds
2019-01-15 12:09:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 12:09:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:10:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 12:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:10:20 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 12:10:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:10:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:11:04 [DEBUG   ] Got command RPT from MCS: ref #1175759
2019-01-15 12:11:04 [DEBUG   ] summary = ERROR
2019-01-15 12:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175759  13 58498 43864993 A  ERRORERROR'
2019-01-15 12:11:04 [DEBUG   ] Got command RPT from MCS: ref #1175760
2019-01-15 12:11:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175760  77 58498 43864994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:11:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:11:19 [DEBUG   ] Got command RPT from MCS: ref #1175776
2019-01-15 12:11:19 [DEBUG   ] summary = ERROR
2019-01-15 12:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175776  13 58498 43879049 A  ERRORERROR'
2019-01-15 12:11:19 [DEBUG   ] Got command RPT from MCS: ref #1175777
2019-01-15 12:11:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175777  77 58498 43879257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:11:19 [DEBUG   ] Got command RPT from MCS: ref #1175778
2019-01-15 12:11:19 [DEBUG   ] summary = ERROR
2019-01-15 12:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175778  13 58498 43879461 A  ERRORERROR'
2019-01-15 12:11:19 [DEBUG   ] Got command RPT from MCS: ref #1175779
2019-01-15 12:11:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175779  77 58498 43879657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:11:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:11:19 [DEBUG   ] Got command RPT from MCS: ref #1175780
2019-01-15 12:11:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175780  12 58498 43879861 A  ERRORBŒÌÍ'
2019-01-15 12:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:11:20 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-15 12:11:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:11:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:12:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 12:12:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:12:20 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-15 12:12:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:12:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:13:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:13:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:13:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:13:20 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 12:13:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:13:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 12:14:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 12:14:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:14:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:14:20 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-15 12:14:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:14:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 12:15:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 12:15:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:15:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:15:20 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-15 12:15:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 12:15:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 12:16:05 [DEBUG   ] Got command RPT from MCS: ref #1175789
2019-01-15 12:16:05 [DEBUG   ] summary = ERROR
2019-01-15 12:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175789  13 58498 44165001 A  ERRORERROR'
2019-01-15 12:16:05 [DEBUG   ] Got command RPT from MCS: ref #1175790
2019-01-15 12:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175790  77 58498 44165002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:16:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:16:19 [DEBUG   ] Got command RPT from MCS: ref #1175808
2019-01-15 12:16:19 [DEBUG   ] summary = ERROR
2019-01-15 12:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175808  13 58498 44179137 A  ERRORERROR'
2019-01-15 12:16:19 [DEBUG   ] Got command RPT from MCS: ref #1175809
2019-01-15 12:16:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175809  77 58498 44179341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:16:19 [DEBUG   ] Got command RPT from MCS: ref #1175810
2019-01-15 12:16:19 [DEBUG   ] summary = ERROR
2019-01-15 12:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175810  13 58498 44179533 A  ERRORERROR'
2019-01-15 12:16:19 [DEBUG   ] Got command RPT from MCS: ref #1175812
2019-01-15 12:16:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175812  77 58498 44179737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:16:19 [DEBUG   ] Got command RPT from MCS: ref #1175813
2019-01-15 12:16:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175813  12 58498 44179942 A  ERRORB�ÌÍ'
2019-01-15 12:16:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:16:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:16:20 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-15 12:16:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:16:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:17:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 12:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:17:20 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-01-15 12:17:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:17:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 12:18:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:18:21 [DEBUG   ] Finished updating board flags in 2.250 seconds
2019-01-15 12:18:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:18:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 12:19:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 12:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:19:21 [DEBUG   ] Finished updating board flags in 2.114 seconds
2019-01-15 12:19:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:19:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 12:20:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 12:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:20:21 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-15 12:20:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 12:20:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 12:21:04 [DEBUG   ] Got command RPT from MCS: ref #1175826
2019-01-15 12:21:04 [DEBUG   ] summary = ERROR
2019-01-15 12:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175826  13 58498 44464997 A  ERRORERROR'
2019-01-15 12:21:04 [DEBUG   ] Got command RPT from MCS: ref #1175827
2019-01-15 12:21:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175827  77 58498 44464998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:21:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 12:21:19 [DEBUG   ] Got command RPT from MCS: ref #1175843
2019-01-15 12:21:19 [DEBUG   ] summary = ERROR
2019-01-15 12:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175843  13 58498 44479217 A  ERRORERROR'
2019-01-15 12:21:19 [DEBUG   ] Got command RPT from MCS: ref #1175844
2019-01-15 12:21:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175844  77 58498 44479421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:21:19 [DEBUG   ] Got command RPT from MCS: ref #1175845
2019-01-15 12:21:19 [DEBUG   ] summary = ERROR
2019-01-15 12:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175845  13 58498 44479625 A  ERRORERROR'
2019-01-15 12:21:19 [DEBUG   ] Got command RPT from MCS: ref #1175846
2019-01-15 12:21:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175846  77 58498 44479817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:21:20 [DEBUG   ] Got command RPT from MCS: ref #1175847
2019-01-15 12:21:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175847  12 58498 44480022 A  ERRORBnff'
2019-01-15 12:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:21:21 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-15 12:21:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 12:21:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:22:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:22:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:22:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:22:21 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 12:22:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:22:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:23:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 12:23:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:23:21 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-15 12:23:34 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-15 12:23:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 12:24:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 12:24:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:24:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:24:21 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 12:24:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 12:24:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:25:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:25:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:25:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 12:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:25:21 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-15 12:25:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 12:25:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:26:05 [DEBUG   ] Got command RPT from MCS: ref #1175852
2019-01-15 12:26:05 [DEBUG   ] summary = ERROR
2019-01-15 12:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175852  13 58498 44765005 A  ERRORERROR'
2019-01-15 12:26:05 [DEBUG   ] Got command RPT from MCS: ref #1175853
2019-01-15 12:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175853  77 58498 44765006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:26:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:26:19 [DEBUG   ] Got command RPT from MCS: ref #1175871
2019-01-15 12:26:19 [DEBUG   ] summary = ERROR
2019-01-15 12:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175871  13 58498 44779297 A  ERRORERROR'
2019-01-15 12:26:19 [DEBUG   ] Got command RPT from MCS: ref #1175872
2019-01-15 12:26:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175872  77 58498 44779501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:26:19 [DEBUG   ] Got command RPT from MCS: ref #1175873
2019-01-15 12:26:19 [DEBUG   ] summary = ERROR
2019-01-15 12:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175873  13 58498 44779705 A  ERRORERROR'
2019-01-15 12:26:19 [DEBUG   ] Got command RPT from MCS: ref #1175875
2019-01-15 12:26:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175875  77 58498 44779897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:26:20 [DEBUG   ] Got command RPT from MCS: ref #1175876
2019-01-15 12:26:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175876  12 58498 44780101 A  ERRORB–™š'
2019-01-15 12:26:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:26:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:26:21 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-15 12:26:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:26:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:27:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 12:27:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:27:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:27:21 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-15 12:27:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 12:27:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:28:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 12:28:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:28:21 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-15 12:28:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 12:28:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 12:29:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:29:22 [DEBUG   ] Finished updating board flags in 2.066 seconds
2019-01-15 12:29:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 12:29:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 12:30:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 12:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:30:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:30:22 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-01-15 12:30:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 12:30:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 12:31:05 [DEBUG   ] Got command RPT from MCS: ref #1175889
2019-01-15 12:31:05 [DEBUG   ] summary = ERROR
2019-01-15 12:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175889  13 58498 45065009 A  ERRORERROR'
2019-01-15 12:31:05 [DEBUG   ] Got command RPT from MCS: ref #1175890
2019-01-15 12:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175890  77 58498 45065010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:31:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 12:31:19 [DEBUG   ] Got command RPT from MCS: ref #1175906
2019-01-15 12:31:19 [DEBUG   ] summary = ERROR
2019-01-15 12:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175906  13 58498 45079373 A  ERRORERROR'
2019-01-15 12:31:19 [DEBUG   ] Got command RPT from MCS: ref #1175907
2019-01-15 12:31:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175907  77 58498 45079577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:31:19 [DEBUG   ] Got command RPT from MCS: ref #1175908
2019-01-15 12:31:19 [DEBUG   ] summary = ERROR
2019-01-15 12:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175908  13 58498 45079781 A  ERRORERROR'
2019-01-15 12:31:19 [DEBUG   ] Got command RPT from MCS: ref #1175909
2019-01-15 12:31:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175909  77 58498 45079985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:31:20 [DEBUG   ] Got command RPT from MCS: ref #1175910
2019-01-15 12:31:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175910  12 58498 45080177 A  ERRORB˜™š'
2019-01-15 12:31:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:31:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:31:22 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-15 12:31:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:31:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 12:32:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:32:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:32:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:32:22 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-15 12:32:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:32:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:33:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:33:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:33:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:33:22 [DEBUG   ] Finished updating board flags in 1.639 seconds
2019-01-15 12:33:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:33:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:34:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 12:34:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:34:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:34:22 [DEBUG   ] Finished updating board flags in 1.558 seconds
2019-01-15 12:34:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:34:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:35:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:35:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:35:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:35:22 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-15 12:35:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 12:35:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 12:36:05 [DEBUG   ] Got command RPT from MCS: ref #1175919
2019-01-15 12:36:05 [DEBUG   ] summary = ERROR
2019-01-15 12:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175919  13 58498 45365005 A  ERRORERROR'
2019-01-15 12:36:05 [DEBUG   ] Got command RPT from MCS: ref #1175920
2019-01-15 12:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175920  77 58498 45365006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:36:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 12:36:19 [DEBUG   ] Got command RPT from MCS: ref #1175938
2019-01-15 12:36:19 [DEBUG   ] summary = ERROR
2019-01-15 12:36:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175938  13 58498 45379453 A  ERRORERROR'
2019-01-15 12:36:19 [DEBUG   ] Got command RPT from MCS: ref #1175939
2019-01-15 12:36:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:36:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175939  77 58498 45379657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:36:19 [DEBUG   ] Got command RPT from MCS: ref #1175940
2019-01-15 12:36:19 [DEBUG   ] summary = ERROR
2019-01-15 12:36:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175940  13 58498 45379861 A  ERRORERROR'
2019-01-15 12:36:20 [DEBUG   ] Got command RPT from MCS: ref #1175942
2019-01-15 12:36:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175942  77 58498 45380065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:36:20 [DEBUG   ] Got command RPT from MCS: ref #1175944
2019-01-15 12:36:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175944  12 58498 45380257 A  ERRORB—™š'
2019-01-15 12:36:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:36:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:36:22 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 12:36:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 12:36:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 12:37:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 12:37:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 12:37:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:37:22 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-15 12:37:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 12:37:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:38:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:38:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:38:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:38:23 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-01-15 12:38:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:38:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:39:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:39:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:39:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:39:23 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-15 12:39:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:39:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 12:40:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 12:40:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:40:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:40:23 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-15 12:40:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:40:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #1175952
2019-01-15 12:41:05 [DEBUG   ] summary = ERROR
2019-01-15 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175952  13 58498 45665001 A  ERRORERROR'
2019-01-15 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #1175953
2019-01-15 12:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175953  77 58498 45665002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:41:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 12:41:19 [DEBUG   ] Got command RPT from MCS: ref #1175969
2019-01-15 12:41:19 [DEBUG   ] summary = ERROR
2019-01-15 12:41:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175969  13 58498 45679533 A  ERRORERROR'
2019-01-15 12:41:19 [DEBUG   ] Got command RPT from MCS: ref #1175970
2019-01-15 12:41:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:41:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175970  77 58498 45679737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:41:19 [DEBUG   ] Got command RPT from MCS: ref #1175971
2019-01-15 12:41:19 [DEBUG   ] summary = ERROR
2019-01-15 12:41:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175971  13 58498 45679941 A  ERRORERROR'
2019-01-15 12:41:20 [DEBUG   ] Got command RPT from MCS: ref #1175972
2019-01-15 12:41:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175972  77 58498 45680145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:41:20 [DEBUG   ] Got command RPT from MCS: ref #1175973
2019-01-15 12:41:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175973  12 58498 45680337 A  ERRORB–™š'
2019-01-15 12:41:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:41:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:41:23 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-15 12:41:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 12:41:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 12:42:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 12:42:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:42:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:42:23 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-15 12:42:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 12:42:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:43:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-15 12:43:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:43:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:43:23 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-15 12:43:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 12:43:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 12:44:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:44:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:44:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:44:23 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 12:44:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 12:44:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 12:45:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 12:45:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:45:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:45:23 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-15 12:45:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 12:45:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:46:05 [DEBUG   ] Got command RPT from MCS: ref #1175982
2019-01-15 12:46:05 [DEBUG   ] summary = ERROR
2019-01-15 12:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175982  13 58498 45965009 A  ERRORERROR'
2019-01-15 12:46:05 [DEBUG   ] Got command RPT from MCS: ref #1175983
2019-01-15 12:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1175983  77 58498 45965010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:46:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 12:46:19 [DEBUG   ] Got command RPT from MCS: ref #1176001
2019-01-15 12:46:19 [DEBUG   ] summary = ERROR
2019-01-15 12:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176001  13 58498 45979613 A  ERRORERROR'
2019-01-15 12:46:19 [DEBUG   ] Got command RPT from MCS: ref #1176002
2019-01-15 12:46:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176002  77 58498 45979817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:46:20 [DEBUG   ] Got command RPT from MCS: ref #1176003
2019-01-15 12:46:20 [DEBUG   ] summary = ERROR
2019-01-15 12:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176003  13 58498 45980021 A  ERRORERROR'
2019-01-15 12:46:20 [DEBUG   ] Got command RPT from MCS: ref #1176005
2019-01-15 12:46:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176005  77 58498 45980225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:46:20 [DEBUG   ] Got command RPT from MCS: ref #1176006
2019-01-15 12:46:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176006  12 58498 45980417 A  ERRORB—™š'
2019-01-15 12:46:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 12:46:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:46:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:46:23 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-15 12:46:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 12:46:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:47:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:47:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:47:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:47:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:47:23 [WARNING ] (13, 1, 'bot')
2019-01-15 12:47:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:47:23 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-15 12:47:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:47:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 12:48:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:48:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 12:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:48:24 [DEBUG   ] Finished updating board flags in 2.056 seconds
2019-01-15 12:48:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:48:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:49:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:49:24 [DEBUG   ] Finished updating board flags in 2.062 seconds
2019-01-15 12:49:39 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-15 12:49:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 12:50:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 12:50:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:50:24 [DEBUG   ] Finished updating board flags in 1.936 seconds
2019-01-15 12:50:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 12:51:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 12:51:05 [DEBUG   ] Got command RPT from MCS: ref #1176019
2019-01-15 12:51:05 [DEBUG   ] summary = ERROR
2019-01-15 12:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176019  13 58498 46265009 A  ERRORERROR'
2019-01-15 12:51:05 [DEBUG   ] Got command RPT from MCS: ref #1176020
2019-01-15 12:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176020  77 58498 46265010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:51:19 [DEBUG   ] Got command RPT from MCS: ref #1176036
2019-01-15 12:51:19 [DEBUG   ] summary = ERROR
2019-01-15 12:51:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176036  13 58498 46279701 A  ERRORERROR'
2019-01-15 12:51:19 [DEBUG   ] Got command RPT from MCS: ref #1176037
2019-01-15 12:51:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:51:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176037  77 58498 46279893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:51:20 [DEBUG   ] Got command RPT from MCS: ref #1176038
2019-01-15 12:51:20 [DEBUG   ] summary = ERROR
2019-01-15 12:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176038  13 58498 46280097 A  ERRORERROR'
2019-01-15 12:51:20 [DEBUG   ] Got command RPT from MCS: ref #1176039
2019-01-15 12:51:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176039  77 58498 46280301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:51:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 12:51:20 [DEBUG   ] Got command RPT from MCS: ref #1176040
2019-01-15 12:51:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176040  12 58498 46280505 A  ERRORB—™š'
2019-01-15 12:51:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:51:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:51:24 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 12:51:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 12:52:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 12:52:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 12:52:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:52:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:52:24 [DEBUG   ] Finished updating board flags in 1.842 seconds
2019-01-15 12:52:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 12:53:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 12:53:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:53:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:53:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:53:24 [DEBUG   ] Finished updating board flags in 1.766 seconds
2019-01-15 12:53:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 12:54:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 12:54:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 12:54:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:54:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 12:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:54:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:54:24 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-15 12:54:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 12:55:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 12:55:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 12:55:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:55:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:55:24 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-01-15 12:55:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:56:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 12:56:05 [DEBUG   ] Got command RPT from MCS: ref #1176045
2019-01-15 12:56:05 [DEBUG   ] summary = ERROR
2019-01-15 12:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176045  13 58498 46565013 A  ERRORERROR'
2019-01-15 12:56:05 [DEBUG   ] Got command RPT from MCS: ref #1176046
2019-01-15 12:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176046  77 58498 46565014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:56:19 [DEBUG   ] Got command RPT from MCS: ref #1176064
2019-01-15 12:56:19 [DEBUG   ] summary = ERROR
2019-01-15 12:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176064  13 58498 46579774 A  ERRORERROR'
2019-01-15 12:56:19 [DEBUG   ] Got command RPT from MCS: ref #1176065
2019-01-15 12:56:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176065  77 58498 46579977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:56:20 [DEBUG   ] Got command RPT from MCS: ref #1176066
2019-01-15 12:56:20 [DEBUG   ] summary = ERROR
2019-01-15 12:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176066  13 58498 46580181 A  ERRORERROR'
2019-01-15 12:56:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:56:20 [DEBUG   ] Got command RPT from MCS: ref #1176068
2019-01-15 12:56:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 12:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176068  77 58498 46580385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 12:56:20 [DEBUG   ] Got command RPT from MCS: ref #1176069
2019-01-15 12:56:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 12:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176069  12 58498 46580577 A  ERRORB–™š'
2019-01-15 12:56:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:56:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 12:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:56:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:56:24 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-15 12:56:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 12:57:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 12:57:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 12:57:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:57:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:57:24 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 12:57:41 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-15 12:58:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 12:58:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 12:58:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:58:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:58:24 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 12:58:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 12:59:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 12:59:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 12:59:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 12:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 12:59:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 12:59:24 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 12:59:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 13:00:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 13:00:22 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-15 13:00:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:00:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:00:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:00:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:00:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:00:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:00:24 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-15 13:00:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:01:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 13:01:05 [DEBUG   ] Got command RPT from MCS: ref #1176082
2019-01-15 13:01:05 [DEBUG   ] summary = ERROR
2019-01-15 13:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176082  13 58498 46865009 A  ERRORERROR'
2019-01-15 13:01:05 [DEBUG   ] Got command RPT from MCS: ref #1176083
2019-01-15 13:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176083  77 58498 46865010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:01:19 [DEBUG   ] Got command RPT from MCS: ref #1176099
2019-01-15 13:01:19 [DEBUG   ] summary = ERROR
2019-01-15 13:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176099  13 58498 46879853 A  ERRORERROR'
2019-01-15 13:01:20 [DEBUG   ] Got command RPT from MCS: ref #1176100
2019-01-15 13:01:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176100  77 58498 46880057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:01:20 [DEBUG   ] Got command RPT from MCS: ref #1176101
2019-01-15 13:01:20 [DEBUG   ] summary = ERROR
2019-01-15 13:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176101  13 58498 46880261 A  ERRORERROR'
2019-01-15 13:01:20 [DEBUG   ] Got command RPT from MCS: ref #1176102
2019-01-15 13:01:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176102  77 58498 46880465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:01:20 [DEBUG   ] Got command RPT from MCS: ref #1176103
2019-01-15 13:01:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176103  12 58498 46880657 A  ERRORB–™š'
2019-01-15 13:01:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 13:01:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 13:01:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:01:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:01:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:01:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:01:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:01:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:01:24 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 13:01:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 13:02:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 13:02:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 13:02:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 13:02:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:02:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:02:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:02:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:02:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:02:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:02:24 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-15 13:02:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 13:03:02 [DEBUG   ] Finished updating ant stats in 0.778 seconds
2019-01-15 13:03:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 13:03:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:03:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:03:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:03:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:03:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:03:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:03:24 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-15 13:03:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:04:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 13:04:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 13:04:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:04:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:04:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:04:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:04:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:04:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:04:24 [DEBUG   ] Finished updating board flags in 1.452 seconds
2019-01-15 13:04:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 13:05:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 13:05:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 13:05:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 13:05:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:05:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:05:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:05:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:05:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:05:24 [WARNING ] (13, 1, 'bot')
2019-01-15 13:05:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:05:24 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-01-15 13:05:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 13:06:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 13:06:05 [DEBUG   ] Got command RPT from MCS: ref #1176112
2019-01-15 13:06:05 [DEBUG   ] summary = ERROR
2019-01-15 13:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176112  13 58498 47165005 A  ERRORERROR'
2019-01-15 13:06:05 [DEBUG   ] Got command RPT from MCS: ref #1176113
2019-01-15 13:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176113  77 58498 47165006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:06:19 [DEBUG   ] Got command RPT from MCS: ref #1176131
2019-01-15 13:06:19 [DEBUG   ] summary = ERROR
2019-01-15 13:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176131  13 58498 47179933 A  ERRORERROR'
2019-01-15 13:06:20 [DEBUG   ] Got command RPT from MCS: ref #1176132
2019-01-15 13:06:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176132  77 58498 47180137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:06:20 [DEBUG   ] Got command RPT from MCS: ref #1176133
2019-01-15 13:06:20 [DEBUG   ] summary = ERROR
2019-01-15 13:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176133  13 58498 47180341 A  ERRORERROR'
2019-01-15 13:06:20 [DEBUG   ] Got command RPT from MCS: ref #1176135
2019-01-15 13:06:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176135  77 58498 47180533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:06:20 [DEBUG   ] Got command RPT from MCS: ref #1176137
2019-01-15 13:06:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176137  12 58498 47180737 A  ERRORB˜™š'
2019-01-15 13:06:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 13:06:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:06:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:06:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:06:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:06:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:06:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:06:25 [DEBUG   ] Finished updating board flags in 2.239 seconds
2019-01-15 13:06:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:07:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:07:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 13:07:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:07:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:07:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:07:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:07:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:07:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:07:25 [DEBUG   ] Finished updating board flags in 2.163 seconds
2019-01-15 13:07:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 13:08:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:08:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 13:08:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:08:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:08:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:08:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:08:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:08:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:08:25 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-15 13:08:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 13:09:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 13:09:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 13:09:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:09:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:09:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:09:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:09:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:09:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:09:25 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-15 13:09:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 13:10:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 13:10:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 13:10:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:10:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:10:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:10:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:10:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:10:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:10:25 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-15 13:10:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 13:11:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 13:11:05 [DEBUG   ] Got command RPT from MCS: ref #1176145
2019-01-15 13:11:05 [DEBUG   ] summary = ERROR
2019-01-15 13:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176145  13 58498 47465013 A  ERRORERROR'
2019-01-15 13:11:05 [DEBUG   ] Got command RPT from MCS: ref #1176146
2019-01-15 13:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176146  77 58498 47465014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:11:20 [DEBUG   ] Got command RPT from MCS: ref #1176162
2019-01-15 13:11:20 [DEBUG   ] summary = ERROR
2019-01-15 13:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176162  13 58498 47480013 A  ERRORERROR'
2019-01-15 13:11:20 [DEBUG   ] Got command RPT from MCS: ref #1176163
2019-01-15 13:11:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176163  77 58498 47480217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:11:20 [DEBUG   ] Got command RPT from MCS: ref #1176164
2019-01-15 13:11:20 [DEBUG   ] summary = ERROR
2019-01-15 13:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176164  13 58498 47480421 A  ERRORERROR'
2019-01-15 13:11:20 [DEBUG   ] Got command RPT from MCS: ref #1176165
2019-01-15 13:11:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176165  77 58498 47480613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:11:20 [DEBUG   ] Got command RPT from MCS: ref #1176166
2019-01-15 13:11:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176166  12 58498 47480817 A  ERRORB—™š'
2019-01-15 13:11:24 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2019-01-15 13:11:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:11:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:11:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:11:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:11:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:11:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:11:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:11:25 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-15 13:11:44 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2019-01-15 13:12:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:12:24 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2019-01-15 13:12:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:12:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:12:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:12:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:12:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:12:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:12:25 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-15 13:12:44 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-01-15 13:13:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:13:24 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-01-15 13:13:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:13:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:13:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:13:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:13:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:13:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:13:25 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-15 13:13:44 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-01-15 13:14:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 13:14:24 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2019-01-15 13:14:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:14:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:14:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:14:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:14:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:14:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:14:25 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-15 13:14:45 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2019-01-15 13:15:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 13:15:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 13:15:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:15:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:15:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:15:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:15:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:15:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:15:26 [DEBUG   ] Finished updating board flags in 2.607 seconds
2019-01-15 13:15:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 13:16:05 [DEBUG   ] Got command RPT from MCS: ref #1176175
2019-01-15 13:16:05 [DEBUG   ] summary = ERROR
2019-01-15 13:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176175  13 58498 47765009 A  ERRORERROR'
2019-01-15 13:16:05 [DEBUG   ] Got command RPT from MCS: ref #1176176
2019-01-15 13:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176176  77 58498 47765010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:16:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 13:16:20 [DEBUG   ] Got command RPT from MCS: ref #1176194
2019-01-15 13:16:20 [DEBUG   ] summary = ERROR
2019-01-15 13:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176194  13 58498 47780097 A  ERRORERROR'
2019-01-15 13:16:20 [DEBUG   ] Got command RPT from MCS: ref #1176195
2019-01-15 13:16:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176195  77 58498 47780301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:16:20 [DEBUG   ] Got command RPT from MCS: ref #1176196
2019-01-15 13:16:20 [DEBUG   ] summary = ERROR
2019-01-15 13:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176196  13 58498 47780493 A  ERRORERROR'
2019-01-15 13:16:20 [DEBUG   ] Got command RPT from MCS: ref #1176197
2019-01-15 13:16:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176197  77 58498 47780697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:16:20 [DEBUG   ] Got command RPT from MCS: ref #1176199
2019-01-15 13:16:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176199  12 58498 47780901 A  ERRORB–™š'
2019-01-15 13:16:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:16:25 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2019-01-15 13:16:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:16:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:16:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:16:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:16:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:16:25 [DEBUG   ] Finished updating board flags in 1.651 seconds
2019-01-15 13:16:45 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-01-15 13:17:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:17:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 13:17:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:17:25 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-01-15 13:17:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:17:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:17:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:17:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:17:25 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 13:17:45 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-15 13:18:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 13:18:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:18:25 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2019-01-15 13:18:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:18:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:18:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:18:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:18:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:18:25 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-15 13:18:46 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2019-01-15 13:19:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 13:19:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:19:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:19:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:19:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:19:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:19:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:19:25 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-15 13:19:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 13:19:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 13:20:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 13:20:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:20:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:20:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:20:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:20:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:20:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:20:25 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-15 13:20:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 13:20:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 13:21:05 [DEBUG   ] Got command RPT from MCS: ref #1176212
2019-01-15 13:21:05 [DEBUG   ] summary = ERROR
2019-01-15 13:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176212  13 58498 48065013 A  ERRORERROR'
2019-01-15 13:21:05 [DEBUG   ] Got command RPT from MCS: ref #1176213
2019-01-15 13:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176213  77 58498 48065014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:21:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 13:21:20 [DEBUG   ] Got command RPT from MCS: ref #1176229
2019-01-15 13:21:20 [DEBUG   ] summary = ERROR
2019-01-15 13:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176229  13 58498 48080177 A  ERRORERROR'
2019-01-15 13:21:20 [DEBUG   ] Got command RPT from MCS: ref #1176230
2019-01-15 13:21:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176230  77 58498 48080381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:21:20 [DEBUG   ] Got command RPT from MCS: ref #1176231
2019-01-15 13:21:20 [DEBUG   ] summary = ERROR
2019-01-15 13:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176231  13 58498 48080573 A  ERRORERROR'
2019-01-15 13:21:20 [DEBUG   ] Got command RPT from MCS: ref #1176232
2019-01-15 13:21:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176232  77 58498 48080777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:21:20 [DEBUG   ] Got command RPT from MCS: ref #1176233
2019-01-15 13:21:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176233  12 58498 48080981 A  ERRORB—™š'
2019-01-15 13:21:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:21:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:21:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:21:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:21:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:21:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:21:25 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-01-15 13:21:26 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-15 13:21:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:22:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 13:22:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:22:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:22:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:22:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:22:25 [WARNING ] (13, 1, 'bot')
2019-01-15 13:22:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:22:25 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-15 13:22:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 13:22:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 13:23:07 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 13:23:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:23:26 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2019-01-15 13:23:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:23:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:23:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:23:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:23:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:23:26 [DEBUG   ] Finished updating board flags in 2.267 seconds
2019-01-15 13:23:47 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2019-01-15 13:24:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 13:24:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:24:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:24:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:24:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:24:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:24:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:24:26 [DEBUG   ] Finished updating board flags in 2.189 seconds
2019-01-15 13:24:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 13:24:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
